This Page Is Inserted by IFW Operations 
and is not a part of the Official Record 

BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of 
the original documents submitted by the applicant. 

Defects in the images may include (but are not limited to): 

• BLACK BORDERS 

• TEXT CUT OFF AT TOP, BOTTOM OR SIDES 

• FADED TEXT 

• ILLEGIBLE TEXT 

• SKEWED/SLANTED IMAGES 

• COLORED PHOTOS 

• BLACK OR VERY BLACK AND WHITE DARK PHOTOS 

• GRAY SCALE DOCUMENTS 



IMAGES ARE BEST AVAILABLE COPY. 



As rescanning documents will not correct images, 
please do not report the images to the 
Image Problem Mailbox. 



(19) 



(12) 



(43) Date of publication: 

12.02.1997 Bulletin 1997A)7 

(21) Application nunlber: 96111107.7 

(22) Date of fQing: 1007.1996 



EuropSisches Patentaml 
European Patent Office 
Office europtendes brevets (11) EP 0 758 115 A1 

EUROPEAN PATENT APPLICATION 

(51) Inta.^: G06F 17/30 



(84) Designated Contracting States: 


(72) Inventors: 


DEFRGB 


• Matsuzawa, Tomoko 


(30) Prior'rty: 11.07.1995 JP 174663/95 


KHa-ku, Tokyo (JP) 


• MInagawa, Akihiko 


01 .1 1 .1995 JP 306373/95 


Fukaya-shi, Saftama-ken (JP) 


02.11.1995 JP 285550/95 




(71 ) Applicant: MATSUSHITA ELECTRIC INDUSTRIAL 


(74) Representative: Pellmann, Hans-Bernd, Dipl.-lng. 


etal 


CO., LTD. 


PatentanwaltsbOro 


Kadoma-shl, Osaka-f u, 571 (JP) 


Tiedtke-BQIilIng-Klnne & Partner 




Bavarlaring 4 




80336 MOnchen (DE) 



(54) Scenario editor for multimedia data and scenario reproducing apparatus 



(57) A plurality of individual objects is put together 
to a group of page type objects in a page type object 
producing unit. When a display tinning and a deletion 
timing for the group of page type objects are input, a 
page change timing of each of the page type otsjects in 
the group is automatically set in a page change timing 
setting unit to display the page type objects with a 
dynanvc Image at ec^ intervals in a display period 



between the display timing and the deletion timing. 
Therefore, it is not required to input a display timing and 
a deletion timing for each of the individual objects for the 
purpose of editing a scenario in which the irxJividual 
objects are assigned to frames of dynamic image to dis- 
play the indivkJual objects with the dynamic image, and 
a scenano editing operation can be easily performed. 



FIG. 2 



.22 



USER'S 
SELECTION 



.24 



OBJECT 
INFORMATION 
STORING 
UNIT 

JL 



< 

lO 



PAGE TYPE 

OBJECT 

ppQniiriMJS 

UNIT 



USER' S 
INPUT 

L 



.21 



75 



OBJECT 

SELECTING 

UNIT 




SCENARIO 
INFORMATION 
INPUTTING 
UNIT 
















27 










PAGE CHANGE 
TIMING 




SCENARIO 
INFORMATION 




SETTING 
UNIT 






STORING 
UNIT 



TO SCBMRIO 
REPRODUCING 
UNIT 



Q. 
liJ 



Primed by Rank Xertn (UK) BusimaB S«ivIobs 
2.13.1304 



1 



EP0 758115A1 



2 



Description 

BACKGROUND OF THE INVENTION 

1 .FIELD OF THE INVENTION: s 

The present invenlion relates generally to a sce- 
nario editor tor multimedia data and scenario reproduc- 
ing apparatus, and more particuiai ly to a scenario editor 
in which a plurality of static images and texts are io 
assigned to a plurality of frames of display scenes one 
after another on the time4)asis of a series of dynamic 
images and a scenario reproducing apparatus in which 
the static images and texts assigned to the display 
scenes on the time-basis of the dynamic images are is 
reproduced. 

2.DESCRIPTION OF THE RELATED ART: 

In a scenario editor for multimedia data, an editing 20 
operation is performed while setting a parameter relat- 
ing to time information, a parameter relating to layout 
information and a parameter relating to the movement 
of objects. The objects denote multimedia data such as 
a dynamic image, a static image, a text and the like, and 25 
each frame of display scene is corrposed of one 
dynamic image object one or more static image objects 
and text objects included in a configuration of a sce- 
nario. 

In this case, a plurality off static image objects and so 
text objects are assigned to a plurality of frames of dis- 
play scenes on the time-basis of a series of frames of 
dynamic image object in a predetermined order accord- 
ing to the time information as if page data is assigned to 
each of pages of a book. To assign or delete a static 3s 
object or a text object to/from each frame of display 
scene at an arbitrary timing indicated by a frame of 
dynamic image object relating to the time information for 
the purpose of preparing a scenario of a multimedia 
image by using the scenario editor, a scenario editing 40 
operation is performed as follows. 

One frame of dynamic image object used as the 
timing information is selected, the scene of dynamic 
image is reproduced, and a reproducing operation is 
stopped at a particular frame of display scene to display 45 
the selected frame of dynamic image object on a disfslay 
screen. Thereafter, a static or text object to be added or 
deleted to/from the particular frame of display scene is 
selected, and a display timing or a deletion timing of the 
static or text object is set. so 

In this scenario editing operation, only one .object 
can be added or deleted tor each operation. Tnerefore. 
it is required to perform a large nurrt>er of operations 
equal to the number of adding and deleting objects for 
the purpose of preparing a scenario of a multimedia ss 
image. 

Also, an infinite number of scenarios are treated in 
the scenario editor. 



3. PROBLEMS TO BE SOLVED BY THE INVENTION: 

However, in cases where a plurality of static or text 
objects are assigned to a plurality of frames of display 
scene in a predetermined order as if page types data 
are assigned to pages of a book, because only one 
object is added for each scenario editing operation in a 
conventional scenario editor, it is required to select a 
static or text object according to the predetermined 
order for each operation, setting a display position and 
a display size for each selected object and setting a dis- 
play timing or a deletion timing of each selected object, 
and a large number of scenario editing operations are 
troublesonie. 

For example, in cases where a lecture scene of a 
person is displayed on a display screen while displaying 
several tens of pages of materials relating to the lecture, 
the materials are assigned to a plurality of frames of dis- 
play scene as a plurality of static objects on the time- 
basis of the lecture scene treated as a series of frames 
of dynamic object. In this case, it is required to select 
the materials one by one in a predetermined order and 
setting a display timing for each selected material. 
Therefore, there is a drawt^ack that the editing opera- 
tions cannot be efficiently performed. 

Also, though a scenario edition can be arbitrarily 
performed by using a conventional scenario ecfitor. an 
editor is required to perform the scenario editing opera- 
tions while considering the three parameters, so that a 
superior editing faculty is required of the editor. 

SUMMARY QF THE INVENTION 

An object of flie present invention is to provide, with 
due consideration to the drawbacks of such a conven- 
tional scenery editor, a scenery editor in which the 
assignment of a plurality of objects to a series of frames 
of display scene is easily performed even though it is 
required to assign the objects in a predetermined order. 

Also, an object of the present invention is to provide 
a scenario reproducing apparatus in which the scenario 
scene is easily reproduce even tiiough ttie objects are 
assigned in a predetermined order. 

The object of the present invention is achieved by 
the provision of a scenario editor, comprising: 

object information storing means for storing a plu- 
rality of individual objects: 

page type direct producing means for producing 
one or more groups of page type objects from the 
individual objects stored in the object information 
storing means acGording to a user's request; 
object selecting means for selecting a particular 
group of page type objects from among the groups 
of page type objects produced in the page type 
object producing means; 

scenario information inputting means for inputting a 
FNece of intermediate scenario information indicat- 
ing a display timing of the particular group of page 
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type objects selected by the object selecting means 
and a deletion timing of the particular group off page 
type otsjects; and 

page change timing setting means for setting a dis- 
play change timing of each of the page type objects 
in the particular groip selected by the object select- 
ing means according to the display timing and the 
deletion timing of the intermediate scenario infor- 
mation input by the scenario information inputting 
means and assigning the page type objects in the 
particular group to a dynamic image at the display 
change timing set for each of the page type objects 
to edit a scenario composed of the dynamic image 
and the page type objects in the particular group. 

In the above configuration, in cases where a sce- 
nario composed off a dynamic image and a plurality off 
individual objects is edit it is required to assign each off 
the individual objects to the dynamic image at a display 

changing timing. 

In the present invention, the individu^ objects are 
unified to a particular group of page type ejects, and a 
display timing of the particular group of page type 
objects and a deletion timing of the particular group of 
page type objects are input to the scenario information 
inputting means as a piece of Intermediate scenario 
information. Thereafter, a display change timing of each 
of the page type objects in the particular group is set 
according to the display timing and the deletion timing 
by the page change timing setting means, and each off 
the page type objects is assigned to the dynamic image 
at the display change timing. 

Accordingly, the scenario can be easily edit without 
inputting any display change timing of each of the page 
type objects in the particular group. 

The object of the present invention is also achieved 
by the provision of a scenario reproducing apparatus of 
multimedia data for reproducing a scenario in which a 
group of page type objects, conprlsing: 

object information storing means for storing the 
group of page type objects; 
scenario information storing means for storing a 
piece of scenario information of the scenario; 
scenario contarol means for outputting a display 
message or a deletion message of each off the page 
type objects in the Qroup stored in the object infor- 
mation storing means aocofding to the scenario 
information stored in tiie scenario information stor- 
ing means; 

page change control means for performing a page 
change operation for the page type objects in the 
group stored in Vne object information storing 
means according to a user's request; and 
ctoiecX displaying means for displaying or deleting 
each of the page type objects in the group stored in 
the object Information storing means in a display 
period indicated by tiie scenario information 
according to the page change operation performed 



l>y the page diange control means. 

In the above configuration, a user can artxtiarily 
turn each of the page type objects in a reproducing 
5 operation of the scenario. Because it is not required to 
assign a display timing of each of the page type objects 
to the dynamic image, a scenario editing operation can 
be easily performed. 

The object of the present invention is also achieved 
10 by the provision off a scenario editor, comprising: 

layout infornnation receiving means for receiving 
pieces of layout information of a plurality of individ- 
ual objects; 

75 layout information storing means tor storing tiie 
pieces of layout infomfiation received by the layout 
information receiving means; 
object specifying means for specifying a dynamic 
image object and one or more in^vidual objects 

20 selected by a user; 

time information receivlr^ means for receiving a 
display start time and a display finish time for each 
of the individual objects spedffied by the object 
specifying means; 

25 time Information storing means for storing tiie dis- 
play start time and the display finish time received 
by the time information receiving means for each off 
the individual objects; and 
scenario editing means for assigning each of the 

30 irxtividual objects specified by the olaject specifying 
means to the dynaniic image object specified by the 
object specifying means according to the pieces of 
layout information stored in the l^^ut irtformation 
storing means to start the display of each of the 

35 irxfividual objects at the display start time stored in 
the time Information storing means and finish ttie 
display of each of the Individual objects at the dis- 
play finish time stored in the time information stor- 
ing means and obtaining a time relationship 

40 between the dynamic image object and each of the 
individual objects assigned to the dynamic image 
object as an edited scenario. 

In the above configuration, the reception of layout 
45 information by the layout information receiving means 
and the reception of the time information composed off 
the display start time and the display finish time by the 
time information receiving means are separately per- 
fbrmed for each off the individual objects selected by the 
so user, and each of the individual objects is assigned to 
the dynamic image cA)ject according to the layout infor- 
rrwticn arid the time inforrrmtion. Therefore, because 
the user can specify tiie individual objects and the user 
can Input the layout information and the time information 
55 without considering any elapsing time, the scenario can 
be easily edited. 

The object of the present inverrtion is also achieved 
by the provision of a scenario editor comprising: 
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object selecting means for selecting a particular 
dynamic image object from a plurality of dynamic 
image objects and selecting a particular individual 
object from a plurality of Individual objects; 
layout information storing means for storing a piece s 
of dynamic image layout information for the 
dynamic image objects in common and a piece of 
individual object layout information for the individual 
objects in common; 

reproducing and stopping instruction receiving 10 
means for receiving a reproducing instruction and a 
stopping instruction; 

dynamic image reproducing means for reproducing 
the partlcidar dynamic image object selected by the 
object selecting means frame by frame according to is 
the reproducing instructfon received by the repro- 
ducing and stopping instruction receiving means 
and stopping the reproduction off the particular 
dynamic image object at a particular frame accord- 
ing to the stopping instruction received by the 20 
reproducing and stopping Instructian receiving 
means: 

time information storing means for storing the par- 
ticular frame of the particular dynamic image object 
obtained by the dynamic image reproducing 2s 

means; 

selected object displaying means for displaying the 
particular dynamic image object and the particular 
individual object selected by the object selecting 
means, displaying the particular dynamic image 30 
object frame by frame aocoiding to the reproducing 
insfruction received by the reproducing and stop- 
ping instruction receiving means and maintaining 
the display of the particular frame of the particular 
dynamic image object according to the stopping 35 
instruction received by the reproducing and stop- 
ping instruction receiving means: 
scenario editing instruction receiving means for 
receiving a display start timing or a display finish 
timing: and 40 
scenario editing means for assigning the particular 
individual object selected by the object selecting 
means to the particular dynamic image object 
selected by the object selecting means according to 
the dynamic image layout information and the indi- 4s 
vidual object layout information stored in the layout 
information storing means to start the display of the 
particular individual object at the particular frame of 
the particular dynamic image in cases where the 
display start timing is received by the scenario edit- so 
ing Instruction receiving means and to finish the 
display of the particular individual object at the par- 
ticular frame of the particular dynamic image in 
cases wrhere the display finish timing is received t}y 
the scenario editing instruction receiving means 55 
and ot>tainlng a time relationship between the par- 
ticular dynamic image object and the particular IrKll- 
vidual objects assigned to the particular dynamic 
image otiject as an edited scenario. 



In the above oonfiguration. when a user selects the 
particular dynamic image object and the particular indi- 
vidual object, the particular dynamic image object and 
the particular individual object are displayed by the 
selected object displaying means. Therefore, the user 
can confirm the particular dynamic Image object and the 
particular individual object prior to a scenario editing 
(^ration. Thereafter, when a reproducing instruction is 
input to tile reproducing and stewing instruction receiv- 
ing means by the user, the particular dynamic image is 
reproduced by the dynamic image reprodudng means, 
arxl the particular dynamic image is displayed frame by 
frame by the selected object displaying means. Thereaf- 
ter, when a stoppir^ instruction is input to the reproduc- 
ing and stopping instruction receiving means by the 
user, the reproduction of the particular dynamic image 
is stopped by the dynamic image reproducing means, 
and the display of a particular frame of the particular 
dynamic image is maintained by the selected object ds- 
playing means. 

Thereafter, in cases where a di^lay start timing or 
a display finish timing Is input to the scenario editing 
insti-uction receiving means by the user, the particular 
individual ot}ject is assigned to the particular dynamic 
image object by the scenario editing means according 
to the dynamic image layout information and the Individ- 
ual object layout information stored in the layout infor- 
mation storing means to start or f oiish the display of the 
particular individual object at the particular frante of the 
particular dynamic image. 

Acoordingiy, the user can separately perform the 
selection of the objects, the input of the reproducing and 
stopping insti'uctions and the input of the display start 
timing and the display finish timing while checking tiie 
ot>jects shown by the selected object displaying means, 
and a scenario in which the particular individual object 
is assigned to the particular dynamic Image object can 
be easily edited. 

Also, because tiie dynamic Image layout informa- 
tion is fixed for a plurality of dynamic image objects in 
common and the individual object layout Information is 
fixed for a plurality of individual objecte in comrTX)n. the 
user is not required to input any piece of layout informa- 
tion. 

BRIEF PESCRIPTIQNQF THE DRAWINGS 

The objects, features and advantages of the 
present invention will be apparent from the following 
description taken in conjunction with the accompanying 
drawings, in wNch: 

Rg. 1 is a t)lock diagram of a hardware system used 
for emtxxlying a scenario editor and a scenario 
reproducing apparatus accofding to the present 

invention; 

Rg. 2 Is a block diagram of a scenario editor 
according to a first enfoodiment of the present 
invention: 
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Fig. 3 shows an example of dynamic image object 
names indicated by dynamic image identification 
numbers and individuai ot^ect names indicated by 
individual object identification numbers according 
to tlie first embodiment; s 
Rg. 4 shows an example of a page type <*ject def- 
inition file of a static Image produced according to 
the first embodiment and another example of a 
page type object definition file of a text produced 
according to the first errttxxdiment; io 
Fig. 5 shows an example of page type object infor- 
mation produced acconding to the f irst emtxxJiment; 
Rg. 6 shows an example of a configuration of a sce- 
nario edited according to the first embodiment: 
Rg. 7 is a flow chart showing a procedure for set- is 
ting the scenario configuration shown in Rg. 6: 
Rg. 8A is an example of object managing infbnra- 
tion of intermediate scenario information set 
according to the first embodiment; 
Rg. SB is an example of message managing infor- so 
mation of the intermediate scenario infommtion set 
according to the first emtxxliment; 
Rg. 8C Is an example of window managing informa- 
tion of the intermediate scenario information set 
according to the first embodimerrt; ss 
Fig. 9 is a flow chart showing an operation per- 
formed in a page change timing setting unit shown 
in Rg. 2; 

Rg. 10A is an exanple of object managing informa- 
tion of final scenario information F>roduced accord- so 
ing to the first embodiment; 
Fig. 1 0B is an exanqale of message managing infor- 
mation of the final scenario information produced 
according to the first embodiment; 
Rg. IOC is an example of window managing infor- 55 
mation of the final scenario information produced 
according to the first embodiment; 
Rg. 11 is a k^ock diagram of a scenario editor 
according to a second embodiment of the present 
invention; 40 
Rg. 12 shows an example of an operation screen 
provided by a page diange timing setting unit 
shown in Rg. 1 1 ; 

Rg. 13 is a flow chart showing an operation per- 
formed in a page change timing setting unit shown 4S 
in Rg. 11; 

Rg. 14 is a block diagram of a scenario reproducing 
apparatus according to a third embodiment of the 
present invention; 

Rg. 15 shows a scenario reproducing screen so 
according to the third embodiment; 
Rg. 16 is a flow chan showing a procedure par- 
formed when a page advancing button displayed on 
the scenario reproduang saeen is pushed; 
Rg. 1 7 is a flow chart showing a procedure per- ss 
formed when a page returning txjtton displayed on 
the scenario reproducing screen is pushed; 
Rg. 18 is a block diagram of a scenario editor 
according to a fourth embodiment of the present 



invention; 

Rg. 19A is an escample of object managing informa- 
tion of intermediate scenario information changed 
according to the fourth emtxxfiment; 
Rg. 19B is an exanple of message managing Infor- 
mation of the irrtermediate scenario information 
changed according to the fourth embodiment; 
Rg. 19C is an example of wirKiow managing infor- 
mation of the intermediate scenario information 
changed according to tiie fourth embodiment; 
Rg. 20 is an example of a page type object defini- 
tion file for defining a new group of page type 
objects reset according to the fourth embodiment; 
Rg. 21 A is an example of object managing informa- 
tion of final scenario information obtained in ttie 
scenario editor shown in Rg. 18; 
Rg. 21 B is an exanrple of message managing infor- 
mation of the final scenario infbrmation obtained in 
the scenario editor shown in Rg. 18; 
Rg. 21 C is an erarrple of window managing infor- 
mation of the final scenario Information otJtained in 
the scenario editor shown in Rg. 18; 
Rg. 22 is a block diagram of a hyper-video type 
scenario editor according to a fifth embodiment of 
the present invention; 

Rg. 23 shows a configuration of a scenario edited 
in the scenario editor shown in Rg. 22; 
Rg. 24 is a flow chart showing a procedure of a sce- 
nario editing operation performed in the hyper- 
video type scenario editor stiown in Rg. 22; 
Rg. 25 is an exanple of dynamic image object 
information and individual object information for a 
dynamic image object and individual objecls 
selected by a user in tiie hyper-video type scenario 
editor shown in Rg. 22; 

Rg. 26 Is an example of layout Information for the 
selected dynamic image object and the selected 
irxJividual objects; 

Rg. 27 is an example of time information stored In a 
time information storing urat of the scenario editor 
shown in Rg. 22; 

Rg. 28A shows an example of title managing infor- 
mation of an edited scenario obtained in the sce- 
nario editor shown in Rg. 22; 
Rg. 28B shows an example of object managing 
information of an edited scenario obtained in the 
scenario editor shown in Rg. 22; 
Rg. 28C shows an eocample of message managing 
intormatton of an edited scenario obtained in tiie 
scenario editor shown in Rg. 22; 
Rg. 28D shows an example of window managing 
[.nformatlon of an edited scenario obtained in the 
scenario editor shown in Rg. 22; 
Rg. 29 is a block diagram of a hyper-video type 
scenario editor according to a sixth embodiment of 
the present Invention; 

Rg. 30 shows displaying screens and buttons used 

in the scenario editor shown in Rg. 29; 

Rg. 31 is a flow chart showing a display timing set- 
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ting operation performed in a reproducing and stop- 
ping instruction receiving unit of ttie scenario editor 
shown in Fig. 29; 

Ftg. 32 is a flow chart of a display timing setting 
operation performed by a user according to the 

sixth embodiment; 

Rgs. 33A to 33C respectively show an image view 
of an Image screen in a sdected object displaying 
unit of the scenario editor shown in Fig. 29; 
Fig. 34 shows an example of object infomnation 
stored in a object information storing unit of the sce- 
nario editor shown in Rg. 29: 
Rg. 35 shows an example of layout information 
stored in a layout information storing unit of the sce- 
nario editor shown in Fig. 29; 
Fig. 36 shows an example of object information 
stored in a selected object information storing unit 
of the scenario editor shown in Rg. 29; 
Fig. 37 is a flew chart showing a scenario editing 
operation performed in a scenario editing unit of the 
scenario editor shown in Fig. 29; 
Fig. 38 shows an example of title managing infor- 
mation, object managing Information, message 
managing Information and window managing infor- 
mation of a scenario stored in a scenario storing 
unit of the scenario editor shown In Fig. 29; 
Fig. 39 shows an example of title managing infor- 
mation, object managing information, message 
managing information arxi window managing infor- 
mation of another scenario stored in the scenario 
storing unit of the scenario editor shown in Rg. 29: 
Fig. 40 is a block diagram of a hyper-video type 
scenario editor according to a seventh embodiment 
of the present invention; 

Rg. 41 A shows a first example in which a scenario 
stored in a scenario storing unit of the scenario edi- 
tor shown in Rg. 40 is altered by changing a display 
finish timing for one Individual object; 
Rg. 41 B shows a second example in which a sce- 
nario stored in tfie scenario storing unit is altered by 
adding a new Individual object; 
Fig. 41 C shows a third example in which a scenario 
stored in the scenario storing unit is altered by add- 
ing a new individual object; 
Fig. 42A shows an example of an object information 
stored in a displayed object information storing unit 
of the scenario editor shown in Fig. 40; 
Rg. 42B shows another exarrple of an otsject infor- 
mation stored in a displayed object information stor- 
ing unit of the scenario editor shown in Rg. 40; 
Fig. 43 is a flow chart of a scenario editing opera- 
tion performed in a scenario editing unit of the sce- 
nario editor shown In Rg. 40; 
Fig. 44 shows an example of message managing 
information of a scenario altered according to a 
scenario altering operation shown in Rg. 41 A; 
Fig. 45 shows an example of a scenario altered 
according to a scenario altering operation shown in 
Fig. 41 B: 



Rg. 46 shows an example of a scenario altered 
according to a scenario altering operatton shown in 
Rg.41C: 

Rg. 47 is a biodc diagram of a hyper-video type 
5 scenario editor according to an eigfilh embodiment 
of the present inverrtion; 

Rg. 48 shows displaying screens and buttons used 

In the scenario editor shewn in Rg. 47; 

Rg. 49 is a flow chart showing a scenario editing 

10 operation performed in the hyper-v'ideo type sce- 
nario editor shown In Rg. 47; 
Rg. 50 is a flow chart showing a scenario editing 
operation for editing the scenario shown in Rg. 23 
in the hyper-video type scenario editor shown in 

IS Rg. 47; 

Rg. 51 is a fkw chart showing the operation per- 
formed in a display start tinning setting unit of the 
hyper-video type scenario editor shown in Rg. 47; 
and 

20 Rg. 52 is a block diagram of a hyper-video type 
scenario editor according to a ninth embodiment of 
the present invention. 

DETAILED DESCRIPTION QF THE EMBODIMENTS 

25 

Preferred emtxxllments of a scenario editor and a 
scenario reproducing apparatus according to the 
present invention are described with reference to draw- 
ings. 

30 Rg. 1 is a block diagram of a hardware system used 
for embodying a scenario editor and a scenario repro- 
ducing apparatus according to the present invention. 

As shown in Rg. 1, a hardware system 11 com- 
prises a keytjoard 12 for receiving input data, a read 

35 only memory (ROM) 13 for storing a prescribed pro- 
gram, a random access memory (RAM) 14 fcM* storing 
object data received by the keytx>ard 12. a central 
processing unit (CPU) 1 5 for processing the object data 
stored in the RAM 1 4 according to the program stored in 

40 the ROM 13, a display 16 for displaying the processed 
object data, a hard disk 17 for storing scenario informa- 
tion, and a mouse 18 for inputting various instructions. 

(Rrst Embodlmem) 

45 

Rg. 2 is a block digram of a scenario editor 
according to a first embodiment of the present inven- 
tion. 

As shown in Rg. 2, a scenario editor 21 comprises 

50 

an object information storing unit 22 embodied tjy 
the RA.M 14 for storing a plurality of individual 
objects, a plurality of page type objects and a plu- 
rality of page type object definition files, 
ss a page type object producing unit 23 emtxxdied by 
the CPU 15 tor assigning a plurality of page num- 
bers to a plurality of individual objects stored in the 
object information storing unit 22 in an increasing 
order according to a user's request to produce a 
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plurality of page type objects from ttie individiial 
objects and preparing the page type object defini- 
tion files respectively defining a plurality of page 
type ot)ject8 numbered a series of page num- 
bers as a groLp of page type objects, s 
an ot)ject selecting unit 24 embodied by the key- 
board 12 for selecting one or more groups of page 
type objects defined by one or more page type 
object definition files from the page type objects 
stored in the object information storing unit 22 io 
according to a user's request, 
a scer^rio information inputting means 25 emkxxi- 
ied by the keytx>ard 12 for inputting a display posi- 
tion, a display size, a display timing and a deletion 
timing for each group of page type ok^ects selected is 
by the ot^ect selecting unit 24 as a piece of interme- 
diate scenario information, 
a scenario information storing unit 26 embodied t>y 
the RAM 14 for storing the intermediate scenario 
information Input to the scenario Information input- 20 
ting means 25 and storing a piece of final scenario 
information, and 

a page change timing setting unit 27 embodied by 
the CPU 15 for automatically setting a page change 
timing of each of the page type objects in each of 25 
the groups selected by the object selecting unit 24 
according to the display and deletion timing of the 
intermediate scenario information stored in the sce- 
narto information storing unit 26 to assign a plurality 
of page type objects in each of the selected groups 30 
to a dynamic image (or video dips) object at equal 
intervals and adding the page cfiange fining to tfie 
intermediate scenario information to produce the 
final scenario information. 

3$ 

In the above configuration, each of the individual 
and page type objects is a static image (or still picture) 
object, a text object or the like, and a plurality of page 
type objects defined as a group are automatically 
assigned to one or more frames of dynamic objects at 40 
equal intervals according to the change timing of the 
final scenario information. Therefore, in a multimedia 
screen image of a prepared scenario, a plurality of static 
images and a plurality of text images are displayed with 
a series of frames of dynamic image on a window of a 45 
display screen emtxxJied by the display 16 at equal 
intervals as if a reader turns the pages of a book. 

In detail, a user initially prepares a plurality of page 
type objects from a pluraR^ of individual otijects stored 
In the object information storing unit 22. TTiat is, as so 
shown in Rg. 3, three groips such as a group of 
dynamic image objects, a group of individual oujecls 
relating to static images and a group of individual 
objects relating to texts are separately stored in the 
object information storing unit 22, each of the dynamic 55 
objects is indicated by a dynamic object name, each of 
the irxjividual objects is indicated by an individual object 
name, a dynamic image management identification 
number is attached to each of the dynamic Image 



ol^'ects to identify each of the dynamic image objects, 
an individual object m2magement identification number 
such as a static image management identification 
number or a text manag&nent identification number is 
attached to each of the individual objects to identify 
each of the individual objects. 

A plurality of individual objects stored in the object 
information storing unit 22 are selected one by one and 
are numbered by page numbers in tfie page type object 
producing unit 23 to define the individual objects as a 
groLp of page t^e objects. Each group of page type 
objects is defined by a page type object definition file. 
Thereafter, one or more groups of page type objects 
and one or more page type object definition files are 
stored in the object information storing unit 22. In this 
case, tiie page type objects defined by a page type 
object definition file have the same attribute such as a 
static image attribute or a text attritxJte. 

In each of the page type object definition files, as 
shown in Fig. 4, attribute information specifying a type 
of page t^e otsjects, a total page number IrKlicating the 
total number of page type objects in a group and page 
information indicating individual object names of a plu- 
rality of individual objects from which a plurality of page 
type objects are prepared are set 

As shown in Fig. 5. each groip of the page type 
objects is indicated by a page type object name, and a 
page type object management identification numt)er is 
attached to each group of the page type objects to iden- 
tify each group. A piece of page type object information 
composed of one page type object name and one page 
type object management identification number is stored 
with a corresponding group of page type objects in the 
object infbrmation storing unit 22. 

TTiereafter. a configuration of a scenario desired to 
be prepared by the user is set by selecting one or nrore 
groups of page type objects stored in the object infor- 
mation storing unit 22. For example, in cases where the 
configuration of a scenario shown in Fig. 6 is desired to 
be prepared by the user, a first dynamic image object 
named a first dynamic image, a first group of page type 
olsjects and a second group of page type ot^jects are 
selected in ttie object selecting unit 24. a piece of inter- 
mediate scenario information is input to the scenario 
information Inputting unit 25, the display of the first 
dynamic image is started at a frame FO according to tiie 
intermediate scenario infbrmation, ttie display of the first 
groip of page type objects is started at a frame Fi 
according to the intermediate scenario information, the 
display of the secorxl group of page type objects is 
started at a frame F2 according to the intermediate sce- 
nario information, the display of the first group of page 
type objects is finished at a frame F3 according to the 
intermediate scenario information, the display of tiie 
secorjd groip of page type objects is finished at a frame 
F4 according to the intermediate scenario information, 
and the display of the first dynamic image is finished at 
a frame F5 according to the intermediate scenario infor- 
mation. 
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Thereafter, a change timing of each of a plurality of 
page type objects is automaticaOy set in the page 
change timing setting unit 27 according to the configura- 
tion of ttie scenario to display the page type objects in 
tfie fast group at equal intervals between the first and 
third frames F1 and F3 and display the page type 
objects in the second group at equal intervals between 
the second and fourth frames F2 and F4. 

The setting of a scenario configuration is described 
in detail with reference to Rg. 7. 

In a step Si 01. the first dynamic image object liret 
dynamic image" used as a time-basis is selected by the 
user by using the okiject selecting unit 24. In a step 
SI 02, the first group of page type objects and the sec- 
ond group of page type objects are selected in the same 
manner. In a step SI 03. a display position and a display 
size are input to the scenario information inputting unit 
25 for each of the page type objects. In a step 8104, a 
starting frame at which the display of a group of page 
type objects is started and a finishing frame at which the 
display of a group of page type objects Is finished are 
input to tiie scenario information inputting unit 25 for 
each of groups. The display positions, the display sizes, 
the starting frames and the finishing frames input to the 
scenario Information inputting unit 25 are converted to a 
piece of intermediate scenario Information in the unit 
25. and the intermediate scenario information is stored 
in the scenario storing unit 26. 

The intermediate scenario information indicates a 
configuration of a scenaria As shown in Figs. 8A to 8C, 
the intermediate scenario information is classified into 
object managing information, message managing infor- 
mation and window managing information. The object 
managing information indicates infbrmation of one 
dynamic Image object and one or more groups of page 
type objects used in a scenario. The message manag- 
ing information indicates the starting and finishing 
frames of each of the dynamic Image object and the 
groups of page type objects. The window managing 
information indicates the display position and size of 
each of tiie groups of page type objects. 

An otsject identification number in the object man- 
aging information is used to identify each of the dynamic 
image object and the groups of page type objects, and 
each otjject identification numlaer con'esponds to a 
dynamic image object name or one page type object 
name of one group of page type objects. A frame in the 
message mana^ng information denotes a frame of the 
dynamic image and is used as a starting timing and a 
finishing tirrung. A message identification number is 
used to identify a type of message. For example, a mes- 
sage identification number "0'' indicaies a uispiay oper- 
ation, and a message Identification number "-1" 
indicates a deletion operation. A window identification 
number is used to identify the dynamic Image or one 
static or text object displayed on a display screen. An 
attribute indicates a type of object such as a dynamic 
image object, a static image or a text A width indicates 
a width of one object displayed on the display screen, A 



height indicates a height of one object displayed on the 
display screen, and X and Y coordinates indicate a posi- 
tion of one ot>ject displayed on ttie display screen. 
Thereafter, a page change timing of each page type 

5 ot]q'ect is set according to the intermediate scenario 
information in the page change timing setting urut 27. 
and a final scenario information is produced. 

In detail, as shown in Fig. 9. intermediate scenario 
information stored in the scenario storing unit 26 is 

10 taken out to the page change timing setting unit 27, and 
one or nwre page type object names set in the object 
managing information are ok)tained from the imermedi- 
ate scenario information (step S201 }. Thereafter, one or 
more page type object definition files indicated by the 

IS page type object names are read out from the olsject 
information storing unit 22 to ttie page change timing 
setting unit 27 (step 8202). Thereafter, the page type 
object names of the object managing information are 
rewritten to a plurality of individual object names of a 

20 plurality of individual objects which are written in each of 
the page type object definition files as the page informa- 
tion (step S203). As a result, the object managing infor- 
mation shown in Rg. 10A is ok>tained. Thereafter, a 
displaying time interval for each page type object is cal- 

25 culated from the starting and finishing frames of one 
group of page type objects in tiie page change timing 
setting unit 27 (step 204). For example, because the 
starting frame for the first group of page type objects is 
the frame F1 arxj the finishing frame tor the first group of 

30 page type objects is the frame F3, in cases where the 
number of page type objects in the first group is twenty, 
a displaying time interval Tl for each page type object is 
Tl « (F3 - F1)/20 . 

Thereafter, though messages of one objact identif i- 

35 cation numt>er. one message Identification number, one 
wirxjow identification number and one attribute are indi- 
cated for each frame in the message managing informa- 
tion as shown in Fig. 8B, the messages are rewritten to 
tiiose indicated for each page type object (step S205). 

40 In this case, a static image object or a text object is writ- 
ten as the attribute, and each of tiie page type object is 
treated as an individual object. For example, after the 
frame FO, the display of a first page type object in the 
first group is started at a divided frame f 1 = F1 . and the 

45 display of the first page type object is finished at a 
divided frame f2 » F1 + (F3-F1 V20 . Also, the display of 
a first page type abject in the second group is started at 
a divided frame 120 s F2 , and ttie display of tine first 
page type object is finished at a divided frame 

50 f21 «F2 + (F4-F2)/10. 

Thereafter, the final scenario information com- 
posed of the written object managing information, the 
written message managing information and the window 
managing information is stored in the scenario storing 

55 unit 26 (step S206). 

Because the final scenario information is expressed 
by a plurality of irxiividual objects, the final scenario 
information can be reproduced in a conventional sce- 
nario reproducing apparatus. 
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Accordingly, because a psiir of starting and finishing 
frames are input tor each groups of page type objects 
and a page change timing is automatically set for each 
of a plurality of page type objects in each group to treat 
each of the page type otijects as an individual object, it s 
Is not reqwred to manually determine a display starting 
timing and a display finishing timing for each of objects, 
and the number of scenario ecfiting operations can be 
considerably reduced. 

Also, because the display time intervals for the io 
page type objects in each group are set at equal inter- 
vals, a scenario in which a display timing for each page 
type object is not strictly required can be easily pro- 
duced. 

IS 

(Second Embodiment) 

In a scenario editor according to a second embodi- 
ment of the present invention, a plurality of page type 
objects in each group are assigned to a dynamic image 2o 
object at desired intervals. 

Fig. 11 is a biock diagram of a scenario editor 
according to a second embodiment of the present 
invention. 

As shown in Rg. 1 1 , a scenario editor 31 comprises 2S 
the object information storing unit 22, the page type 
object producing unit 23, the object selecting unit 24, 
the scenario information inputting means 25, the sce- 
nario information staring unit 26, and 
a page change timing setting unit 32 embodied by the so 
CPU 15 for setting a page change timing off one page 
type object for each of the page type objects in each of 
groups selected tsy the oiaject selecting unit 24 accord- 
ing to the display and deletion timing of the intermediate 
scenario information stored in the scenario information 3s 
storing unit 26 to assign each group of page type 
objects to a dynamic image object at desired interval 
and adding the page change timing to the intermediate 
scenario information to prepare tiie final scenario infor- 
mation. 40 

In the above configuration, a user produces final 
scenario information from the intermediate scenario 
information input to the scenario information inputting 
means in the page change timing setting unit 32 while 
operating an operation screen displayed on the display 4s 
1 6 by the page change timing setting uiit 32. That is. as 
shown in Fig. 12. The operation saeen 41 comprises a 
dynamic image display window 42 for displaying a 
dynamic image frame by frame, a page type object dis- 
play window 43 tor displaying a plurality of page type so 
<A)jects one by one, a reproduction button 44 for repro- 
ducing the dynamic image on the dynamic image dis- 
play window 42, a stop button 45 for stopping the 
r^oduction of the dynamic image, and a page change 
txjtton 46 for changing a page type ot^ect displayed on ss 
the page type object display window 43 to a next one. 

A procedure for producing final scenario informa- 
tion from the intermediate scenario information is per- 
formed according to a flow chart Shown in Rg. 1 3. 



In a step 3301 . an imermediate scenario informa- 
tion stored in tiie scenario storing unit 26 is taken out to 
the page change timing setting unit 32. A user selects 
the first group of page type objects from a plurality of 
groups of page type objects set in the object managing 
information of the intermediate scenario information to 
set a page change timing for each of the page type 
objects in the first group, tn the page change timing set- 
ting unit 32, a page type object definition file corre- 
sponding to the first group of page type objects is read 
out from the object information storing unit 22 to the 
page change timing setting unit 32, the page type object 
name of the first group of page type objects in the object 
managing information of the intermediate scenario 
irrformation is rewritten to a plurality of individual object 
names of a plurality of individual objects which are writ- 
ten in the page type object definition file as the page 
information. Thereafter, the operation screen 41 is dis- 
played on the display 16 under control of the page 
change timing setting unit 32. the dynamic image at the 
first frame F1 is displayed on the dynamic image display 
window 42. and a top page type object in the first group 
is displayed on the page type object display window 43. 

In a step 8302, the user pushes the reproduction 
button 44 to reproduce a plurality of frames of the 
dynamic image frame by frame, and the user pushes 
the stop button 45 when a desired frame Fa of dynamic 
image is displayed on the dynamic in^ge display vnn- 
dow 42. TTierefore. the display of the desired frame Fa 
of dynamic image is meUntained. 

In a step S303, the user pushes the page change 
t)utton 46 to display a second page type obje^ in the 
first group on the page type object display window 43. In 
this case, the message managing information of the 
intermediate scenario information is rewritten to stop 
the display of the top page t^e object at the frame Fa 
and start the display of the second page type olsject at 
the frame Fa. 

The steps S302 and 3303 are repeated until a page 
changing timing for each of all page type objects in the 
first group is set. Also, a page changing timing for each 
of all page type objects in the second group is set in the 
same marvier. As a result, the final scenario information 
is obtained In the same manner as that shown in Figs. 
lOAto IOC. Thereafter, the final scenario information is 
stored in the scenario storing unit 26. 

Because the final scenario information is expressed 
by a plurality of individual objects, flie final scenario 
information can be reproduced in a conventional sce- 
nario reprocbjcing apparahjs. 

Accordingly, because a pair of starting and f inishing 
frames are input tor each groups of page type objects 
and a page change timing is desiratsly set for each of a 
plurality of page type objects in each group to treat each 
of tiie page type objects as an individual object, the user 
can easily set a display starting timing and a display fin- 
ishing timing for each of objects. 

Also, because the display time intervals for the 
page type objects in each group are set at desired inter- 
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vale, a scenario in which a display timing for each page 
type object is strictly required can be easily produced. 

(TTwd Embodimemi) 

In a scenario reproducing apparatus according to a 
third embodiment of tiie present invention, each of the 
page type dejects in one group is reproduced according 
to the intermediate scenario infomiation when the 
reproduction of each page type ot^ect is requested by a 
user. 

Rg. 1 4 is a block diagram of a scenario reproducing 
apparatus according to a third embodiment of the 
present invention. 

As shown in Fig. 14, a scenario reproducing appa- 
ratus 51 comprises 

an otjject Information storing unit 52 embodied Ijy 
the RAM 14 for storing a dynamic image object, a 
plurality of groups of page type objects, a plurality 
of pieces of page type object information (Fig. 5) 
and a plurality of page type object definition files 
(Rg. 4) defining the groups of page type objects, 
a scenario information storing unit 53 emtxxlied by 
the RAM 14 for storing the intermediate scenario 
information. 

a scenario control unit 54 embodied by the CPU 1 5 
for outputting a display message or a deletion mes- 
sage according to the intermediate scenario infor- 
mation stored in the scenario information storing 
unit 53, 

an object displaying unit 55 embodied by the dis- 
play 16 fbr displaying one page type otsject accord- 
ing to the display message or the deletion message 
output from the scenario control unit 54, arxf 
a page change control unit 56 embodied t}y the 
CPU 15 for performing a page changing operation 
In which the page type object displayed on the 
object displaying unit 56 is changed to a next one. 

In the third embodiment, as shown in Fig. 15. a 
dynamic window 61 for displaying a dynamic image, a 
page type object window 62 for displaying a page type 
c^ject such as a static image or a text, a page returning 
button 63 for returning the page type object displayed 
on the page type object window 62 to a previous page 
type object, and a page advancing button 64 for advanc- 
ing the page type object displayed on the page type 
object window 62 to a next page type object is displayed 
on a scenario rqarodudng screen 65 placed in the 
object displaying unit 55. 

The intermediate scenario iniormafion stored in the 
scenario information storing unit 53 is read to the sce- 
nario control unit 54, and a display message or a dele- 
tion message is transmitted from the scenario control 
unit 54 to the object displaying unit 55 at a message 
transmission time (or a frame of the dynamic image) 
specified in the intermediate scenario information to 
control a display or deletion operation of the dynamic 



image object and the page type objects perfonned in 
the object displaying unit 55. For exanpie. because the 
intermecfiate scenario information indicates that the (fis- 
play of the dynamic image object is started at the frame 
FO. the display message is transmitted from the sce- 
nario control unit 54 to the object displaying unit 55 at 
the frame FO, the dynamic image object Is transferred 
from the object information storing unit 52 to the object 
displaying unit 55 under the control of the scenario con- 
trol unit 54, and the dynamic image object is displayed 
on the dynamic window 61 at the frame FO. Also, 
because the intermediate scenario information indi- 
cates that tfie display of the first group of page type 
ot^ects is started at the frame F1. the top page type 
ok^ect in the first group is transferred from the object 
information storing unit 52 to the object displaying unit 
55 under the control of the scenarfo control unit 54, the 
top page type object is displayed on the page type 
object window 62, a display request fbr requesting the 
display of a pair of page change control buttons denot- 
ing the page returning button 63 and the page advanc- 
ing button 64 is transmitted from the scenario control 
unit 54 to the page change control unit 56. Also, 
because the intermediate scenario information indi- 
cates that the display of the first group of page type 
objects is finished at the frame F3. the deletion mes- 
sage is transmitted from the scenario control unit 54 to 
the object displaying unit 55 at the frame F3. the first 
group of page type objects displayed on the page type 
object wrindow 62 is deleted at the frame F3 under the 
control of the scenario control unit 54, a deletion 
request for requesting the deletion of the page change 
control buttons 63 and 64 displayed on the scenario 
reproducing screen 65 is transmitted from the scenario 
control unit 54 to the page change control unit 56. 

In the page change corrtrol unit 56, when the dis- 
play request is rec^'ved. the page change control but- 
tons 63 and 64 are displayed on the scenario 
reproducing screen 65. and a value of a page counter is 
set to 1 . Also, when the deletion request is received, the 
page change control buttons 63 and 64 displayed on the 
scenario reproducing saeen 65 is deleted. 

In cases where a user pushes the page advancing 
button 64 when the button 64 is displayed on the sce- 
nario reproducing screen 65, the page change control 
unit 56 is operated according to a procedure shown in 
Fig. 16. 

In a step S301. it is checked by the page change 
control unit 56 whether or not a value off the page coun- 
ter is equal to 1. In cases where a value of the page 
counter Is set to 1, the page returning button 63 is 
treated as an effective button in a step S302, and the 
value of the page counter is incremented in a step 
S3 03. In contrast, in cases where a value of the page 
counter is not set to 1 in the step S301, the procedure 
jumps to the step S303. 

In a step S304. it is checked by the page change 
control unit 56 whether or not the value of the page 
counter Is equal to the total number of page type objects 
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in the first group. In cases where the value of the page 
counter is equal to the total numtier of page type 
objects, the page advancing txjtton 64 is invalidated in a 
step S305, and a page type object name of a particular 
page type object indicated by the value of the page 5 
counter is taken out from the page type object definition 
file corresponding to the first group of page type objects 
in a step S306. For example, in cases where the value 
of tfie page counter is set to N, a page type object name 
of an N-th page type object in the first group is taken 
out In contrast in cases where the value of the page 
counter is not equal to the total number of page type 
objects in the step S304, the procedure jumps to S306. 

In a step S307, a display request for requesting the 
display of the particular page type ot^ect indicated t>y 
the page type object name is transmitted from the page 
change control unit 56 to the object displaying unit 55. 
Therefore, the particular page type ot^ect is displayed 
on the page type object window 62. 

In contrast, in cases where a user pushes the page 
returning button 63 when the button 64 is displayed on 
the scenario reproducing screen 65. the page change 
control unit 56 is operated according to a procedure 
shown in Fig. 17. 

In a step S401, it is checked by tfie page change 
control unit 56 whether or not a value of the page coun- 
ter is equal to the total number of page type (Ejects in 
the first group. In cases where a value of the page coun- 
ter is equal to the total number of page type objects in 
the first group, the page advancing button 64 Is treated 
as an effective button in a step S402. and the value of 
the page counter is decreased t>y one in a step S403. In 
contrast, in cases where a value of the page counter is 
not equal to the total number of page type ofcjects in the 
step S401 , the procedure junps to the step S403. 

In a step S404, it is checked by the page change 
control unit 56 whether or not the value of the page 
counter is equal to 1 . In cases where the value of the 
page counter is equal to 1 , the page returning txjtton 63 
is invalidated in a step S405, and a page type object 
name of a particular page type object Indicated by the 
value of the page counter is taken out from the page 
type object definition file con-esponding to the first group 
of page type objects in a step S406. For example, in 
cases where the value of the page counter is set to N. a 
page type object name of an N-th page type object in 
the first group is taken out. In contrast, in cases where 
the value of the page counter is not equal to 1 in the 
step S404, the procedure jumps to S406. 

In a step S407, a display request for requesting the 
display of the particular page type object indicated by 
the page type object name is transmitted froni the page 
change control unit 56 to the ot)ject displaying unit 55. 
Therefore, the particular page type object is displayed 
on the page type object window 62. 

Accordingly, because the page type object dis- 
played on the page type object window 62 is changed to 
a next one or a previous one according to the operation 
off a user, an interactive property in the reproduction of 



the group of page type objects can t>e improved. 

Also, because it is not required to fixedly set a dis- 
play timing of each page type object a scenario editing 
operation can be easily perfbrmed. 

(Fourth Embodiment) 

In a scenario editor according to a fourth embodi- 
ment of the present invention, page change timing for a 
part of the page type objects In a group is set according 
to the second embodiment, and any page changing tim- 
ing for the remaining part of the page type objects in the 
grotp is not set. 

Rg. 1 8 is a block diagram of a scenario reproducing 
apparatus according to a third embodiment of the 
present invention. 

As sfiown in Fig. 18, a scenario reproducing appa- 
ratus 71 comprises the object information storing urdt 
22. the page type object producing unit 23, the object 
selecting unit 24. the scenario information inputting 
means 25. the scenario information storing urrit 26. 

the page change timing setting unit 32 for setting a 
page change timing of one page type object for 
each of the page type objects in each of groips 
selected by the object selecting unit 24 according to 
the display and deletion timing of the intermediate 
scenario information stored in the scenario informa- 
tion storing unit 26 to assign a part of a plurality of 
page type objects in a group to a dynamic image 
object at desired interval and adding the paoe 
change timing to the intermediate scenario informa- 
tion, and 

a page type object resetting unit 72 for automati- 
cally resetting the remaining part of the page type 
objects in the group as a new group of page type 
objects. 

In the above configuration, after a page change tim- 
ing for each of a desired part of the page type objects in 
one group is set by the page change timing setting unit 
32. the setting of the page change timing is stopped. For 
example, in cases where a page change timing for each 
of the first five page type objects in the first group is set 
and the setting of the page change timing is stopped, 
ttie scenario information input to the scenario informa- 
tion inputting means 25 is changed, and the object man- 
aging intornnation shown in Fig. ISA. the message 
managing Intbrmation shown in Rg. 19B and the win- 
dow managing informatfon shown in Fig. 19C are 
obtained and stored in the scenario information storing 
unit 26. TTierenfter, the remaining page type objects in 
the first group are processed by the page type object 
resetting unit 72 according to a follow ng procedure to 
produce final scenario information. 

As shown in Fig. 20, a third page type object defini- 
tion file is produced to define the remaining page type 
objects as a third group of page type objects. Thereaf- 
ter, the individual object names of the remaining page 
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type objects in the object managrng information are 
rewritten to a new name "a third page type object". As a 
result, the object managing information shown in Fig. 
21A is obtained and stored in the scenario infonnatlon 
storing unit 26. Thereafter, the message managing 5 
Information Is rewritten to start the display of the third 
group of page type objects at a divided frame f 1 1 and 
finish the display of the third group of page type objects 
at a divided frame f 1 2. As a result the message manag- 
ing information shown in Rg. 21 B is obtained and stored 10 
in the scenario information storing unit 26. Therefore, 
the final scenario information stored in the scenario 
inforn^tion storing unit 26 Is obtained. 

In the final scenario Information, information for the 
trxjividual ofayecte and information for the third group of is 
page type objects are combined. Therefore, a user can 
reproduce a scenario relating to the information for the 
third group of page type obiecls while retuming and 
advancing the page type object displayed on the page 
type object window 62 according to the third embodi* so 
ment. 

Accordingly, the individual objects and the page 
type objects can be reproduced only the scenario 
reiK'oducing apparatus 51 according to the final sce- 
nario information. ss 

Also, a desired part of page type objects can t>e dis- 
played at desired intervals, and the remaining part of 
page type objects can be arbitrarily displayed. 

(Fifth Embodiment) so 

Rg. 22 is a btocK diagram of a hyper-video type 
scenario editor according to a fifth embodiment of the 
present invention. 

As shown in Rg. 22. a hyper-video type scenario 3S 
editor 81 comprises 

a layout information receiving unit 82 embodied by 
the keyboard 12 for receiving layout information 
such as a display position and a display size for 40 
each of individual objects (static image object and 
text object). 

a layout information storing unit 83 Brrbotiied by the 
RAM 14 for storing the layout information received 
in tiie layout information receiving unit 82, 45 
an object name receiving unit 84 emtxxiied by the 
keyboard 12 for receiving a dynamic image object 
name to specify a dynamic image object selected 
by a user as a time ba&e and receiving one or more 
indi^ndual object names to specify one or more irxJi- so 
vidual objects which are selected by the user and 
are planned to be assigned to the dynamic image 
object 

a selected okjject information storing unit 85 
emtxxiied by the RAM 14 for storing dynamic ss 
image object information of the dynamic image 
object selected in the object name receiving unit 84 
and storing individual object information of the indi- 
vidual objects selected in the object name receiving 



unit 84. 

a scenario editing instruction receiving unit 86 
embodied by the mouse 18 for receiving a scenario 
editing instruction such as a display start timing set- 
ting instruction or a display finish timing setting 
instruction, 

a time information receiving unit 87 embodied by 
tiie keytxiard 12 for receiving a display frame of the 
dynamic image, at which the display of each of the 
selected individual objects is started, and a deletion 
frame of the dynamic image, at which the display of 
each of the selected individual objects is finished, 
as time information, 

a time information storing unit 88 embodied by the 
RAM 14 for storing the time information composed 
of the display ftame and the deletion frame for each 
of the selected individual objects, 
a scenario editing unit 89 embodied by the CPU 15 
fbr editing a scenario by using the layout informa- 
tion stored in the layout information storing unit 83, 
tfie object information of the selected dynamic 
image object and tiie selected individual objects 
stored in the selected object information storing unit 
85 and the time information of ttie selected individ- 
ual objects stored in the time information storing 
unit 88 when the scenario editing instruction is 
received in the scenario editing instruction receiv- 
ing unit 86, 

a scenario storing unit 90 embodied t>y tiie hard 
disk 17 for storing the scenario edited in the sce- 
nario editing unit 89, an object display instauction 
receiving unit 91 embodied 1^ the mouse 18 for 
receiving an object display insb-uction, 
an ok^ect data storing unit 92 embodied by the hard 
disk 17 fbr storing data of a plurality of dynamic 
image objects respectively specified by one 
dynamic image object name and data of a plurality 
of individual objects respectively specified by one 
individual object name; 

an object display control unit 93 enrtoodied by the 
CPU 15 for reading out data of the selected 
dynamic image object and data of the selected indi- 
vidual objects from the object data storing unit 92 
according to the scenario stored in the scenario 
storing unit 90 and controlling the display of tiie 
selected individual objects displayed with the 
selected dynamic image object according to the 
scenario when the object display insb-uction is 
received in tiie object display instruction receiving 
unit 91, and 

an object displaying unit 94 embodied by tiie dis- 
play 16 for displaying the selected individual objects 
with the selected dynamic image object under the 
control of the object display control unit 93 to check 
ttiescenaria 

In the atxive configuration, an operation for editing 
a scenarfo of which a configuration is shown in Rg. 23 
is described with reference to Fig. 24. 
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Rg. 24 is a flow chart showing a procedure of a sce- 
nario editing operation performed in the hyper-video 
type Gcenario editor 81 . 

In a step SS01. a user inputs a name lirst dynamic 
i mage' of a selected dynamic image object to the otiject s 
name rec^ving unit 84 to deterntine a plurality of frames 
of dynamic image used as a time-t>ase. 

In a step S502. the user inputs a plurality of object 
names lirst static image" and "first texT to the object 
name receiving unit 84 to determine a plurality of io 
selected individuat objects planned to be assigned to 
the dynamic image. 

An example of dynamic image object information 
and individual object information for the dynamic image 
object and the individual objects selected by the user is is 
shown in Fig. 25. When an object name specifying an 
individual object is input to the receiving unit 84, individ- 
ual object information composed of an object identifica- 
tion number of the individual object, the object name, a 
window identification number indicating a window for 20 
displaying the individual object and an attritxrte indicat- 
ing a data type of the individual object are stored in the 
selected object Information storing unit 85. 

In a step S503, the user Inputs layout information 
such as a display position and a display size to the lay- 25 
out information receiving unit 82 fOr each of the selected 
dynamic image object and the selected individual 
objects, and the layout information is stored in the layout 
Information storing unit 83. An example of the layout 
information for the selected dynamic image object and 30 
the selected individual objects is shown in Rg. 26. 

In a step S504. the user inputs a display frame F1 
of the selected dynamic intage, at which the display of 
the first static image is started, to the time information 
receiving unit 87 as time information. 3S 

In a step S505. the user inputs a deletion frame F3 
of the selected dynamic image, at which the display of 
the first static Image is finished, to the time information 
receiving unit 87 as time Information. The steps S504 
and S505 are repeated to Input a display frame F2 of 40 
dynamic image at which the display of the first text is 
started and the deletion frame F3 of dynamic image at 
which the display of the first text is finished to the time 
information receiving unit 87 as time information. In 
cases where the time information fOr all selected individ- as 
ual objects are input to the time information receiving 
unit 87 (step S506). the time infbrmation are stored in 
the time infbrmation storing unit 88. An example of the 
time information stored in the time infbrmation storing 
unit 88 is shown in Rg. 27. so 

In a step S507. tiie user inputs a scenario editing 
instruction to the scenario editing insiiuciiGn recslving 
unit 86. Therefore, a scenario shown in Fig. 23 Is edited 
according to the layout information stored in the layout 
information storing unit 83, the Individual object informa- ss 
tion stored in the selected object information storing unit 
85 and the time information stored in the time informa- 
tion storing unit 88. and the edited scenarb is stored in 
the scenario storing unit 90. 



In a step S508. when the user ir^uts an object dis- 
play instruction to the object display instruction receiv- 
ing unit 91, data of the selected dynamic image object 
and data of the selected individual objects are read out 
from the object data storing unit 92 under the control of 
the object displ^ control unit 93, and the selected indi- 
vidual objects are displayed with the selected dynamic 
image object on the object displaying unit 94 according 
to the scenario stored in the scenario storing unit 90 
under the control of the object display control unit 93. 

An example of the edited scenario stored in the 
scenario storing unit 90 is shown in Rgs. 28A to 28D. 
Title managing Information for managing a configuration 
of the edited scenario is shown in Rg. 28A, object man- 
aging information for indicating the individual object 
information used in the scenario is shown in Rg. 28B, 
message managing inlormation for indicating a relation- 
ship between the selected individual objects and tiie 
time infbrmation is shown in Rg. 28C. and window man- 
aging infbrmation for indicating the layout infbrmation 
used In the scenario Is shown in Rg. 28D. 

A title name of the title managing information 
denotes a name of a series of frames of images (called 
a title) which are respectively composed of a dynamic 
image and a plurality of individual objects assigned to 
the dynamic image, an object number denotes the 
number of dynamic and Individual objects used In the 
title, a message number derxjtes the number of display 
arxJ deletion frames for all individual objects used In the 
title, a dynamic image window number denotes the 
number of windows used for the dynamic image, a static 
image window number denotes the number of windows 
used for one or more static images used in the titie. arxJ 
a text window number denotes the number of windows 
used for one or more texts used in the title. 

An object identification nurrtoex of the object man- 
aging information is attached to each of tiie dynamic 
image objects and individual objects to identify each of 
the objects. Timing of the message managing informa- 
tion Indicates the numbers of the frames of dynanvc 
image. 

Accordingly, because tiie user can selects one or 
more individual objects by Inputting names of tiie indi- 
vidual objects, the user can Input the layout information 
of each individual object by specifying each object 
name, and the user can inputs the cGspiay timing and 
the deletion timing for each individual oliject by specify- 
ing each object name. Therefore, the scenario can be 
automatically edited according to the individual object 
information of each individual object selected by tiie 
user, the layout information of the selected irKGvidual 
ct^ects and the time information of each incfividual 
object selected by the user even though the user doe 
not consider a time-axis. 

(Sixth Emtxxjiment) 

Rg. 29 is a block diagram of a hyper-video type 
scenario editor according to a sixth embodiment of the 
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present invention. 

As shown in Fig. 29. a hyper-video type scenario 
editor 101 comprises 

an object information storing unit 102 emtxxlied l)y 5 
the RAM 14 for storing pieces of dynamic image 
object Information respectively corrposed of a 
dynamic image object name specifying a dynamic 
image object and a dynamic Image management 
identification number, storing pieces of Individual io 
object information respectively composed of an 
Individual object name specifying an Individual 
object and an individual object management identi- 
fication nurrber and staring data of representative 
images of the dynamic image objects and the indi- is 
vidual objects. 

the object data storing unit 92, 
a list displaying unit 1 03 embodied by the display 1 6 
for displaying the representative images of the 
dynamic image objects and the individual objects bo 
stored In the object information storing unit 102 in a 
list form, 

a layout information storing unit 104 embodied by 
the RAM 14 for storing layout Information indicating 
a display position and a display size for each of the 2S 
individual objects stored in the object data storing 
unH92. 

an object selecting unit 105 embodied by the 
mouse 18 for selecting one dynamic Image object 
and one or more individual objects t)y inputting one 30 
dynamic image object name and one or more indi- 
vidual object names while referring the representa- 
tive images displayed by the list displaying unit 103, 
a selected object displaying unit 106 emisodied by 
the display 16 for reading out data of the dynamic 3S 
image object and the irxJividual objects selected t3y 
the object selecting unit 104 from the object data 
storing unit 92 and displaying the selected dynamic 
image object and the selected individual objects 
according to the layout information stored in the 1^- 40 
out irrformation storing unit 104, 
a selected object information storing unit 107 
embodied by ttie RAM 14 for storing dynamic 
image object information of the dynamic Image 
object and individual object information of the indi- 4S 
vidual objects selected in the object selecting unit 
105, 

a scenario editing insbvction receiving unit 1 12 for 
receiving a display start timing and a display finish 
timing for each of the individual objects selected in so 
the object selecting unit 105. 
a reproducing arxJ stopping instruction receiving 
unit 108 embodied by the mouse 18 for deceiving a 
reproducing instruction or a stopping Instiruction to 
advance the display of a frame of dynamic Image to ss 
a next frame or stop the display of the dynamic 
image, 

a dynamic image reproducing unit 109 embodied 
the CPU IS for reproducing the dynamic image 



according to the reproducing instruction received in 
the reproducing and stopping instruction receiving 
unit 108 to advance a frame of dynamic image dis- 
played by the selected object displaying unit 106 to 
a succeeding frame and stopping the reproduction 
of the dynamic Image according to the stopping 
instruction received in the reproducing and stop- 
l»ng Instruction receiving unit 108 to maintain tlie 
display of the succeeding frame, 
a time Information detecting unit 110 emtxxiied by 
the CPU 15 for detecting the succeeding frame of 
dynamic image reproduced in the dynamic Image 
reproducing unit 109 as a piece of time Information, 
a scenario editing unit 111 embodied by the CPU 
15 16r editing a scenario by using the layout infor- 
mation stored in the layout intbmiation storing unit 
104, the dynamic image and Individual obtject infor- 
mation of the selected dynamic image and individ- 
ual objects stored in the selected object information 
storing unit 107 and the time information detected 
in the time information detecting unit 110 when the 
scenario editing Instiuction is received in the sce- 
nario editing Instruction receiving unit 112, 
the scenario storing unK 90, the object display 
Instruction receiving unit 91 and the object display 
oonf ol unit 93. 

As shown in Rg. 30, the selected object displaying 
unit 106 has an inrrage screen 122. and the image 
screen 122 comprises a dynamic image displaying 
screen 113 for displaying the dynamic Image, a static 
image dsplaying saeen 114 fbr displaying the static 
image object and a text displaying screen 1 15 for dis- 
playing the text object. In this case. The layout Informa- 
tion such as a display position and a display size fbr 
each object displayed on the screen 113. 114or115is 
fixed. Therefore, a user does not required to input any 
layout information, so that a scenario editing operation 
can be sinplifled. 

The reproducing and stopping instruction receiving 
urrit 108 comprises a reproduction button 1 1 6 for chang- 
ing a frame of dynamic image displayed on the d^amic 
image displaying screen 1 1 3 to a next frame, and a stop 
button 117 for stopping ttie change of the frame of 
dynamic image displayed on the dynamic image dis- 
playing saeen 113. 

The scenario editing instruction receiving unit 112 
comprises a display start timing setting button 118 for 
setting a display start timing for each of the selected 
individual objects arxi a display finish timing setting but- 
ton 1 1 9 fbr setting a display finish timing for each of the 
selected indivldua! objects. 

The list displaying unit 103 conrprises an c^ject list 
display screen 120 for displaying a list of objects for 
each of attributes, and three display object changing 
fcHittons 121 for changing an atfibute of objects dis- 
played on the object list display screen 120. 

In the above configuration, an operation performed 
in the hyper-video type scenario editor 1 01 is described 



14 



27 



EP0 758115A1 



28 



with reference to Fig. 31 . 

Rg. 31 is a flow chart showing a display timing set- 
ting operation performed in the reproducing and stop- 
ping instruction receiving unit 108 aocoiding to the sixth 
embodament. s 

In a step S51 1 . a user selects a series of frames of 
dynamic image used as a time base in the object select- 
ing unit 105 by inputting a dynamic image object name 
specifying the dynamic image object. 

In a step S51 2. when the user pushes the reproduc- io 
tion txitton 116. data of the selected dynamic image 
object is transferred from the object data storing unit 92 
to the selected object displaying unit 106, and the 
dynamic image is displayed on the dynamic image dis- 
playing screen 1 13. is 

In a step S513. when a particular frame of the 
dynamic image at vvhich the display of an individual 
object is started is displayed on the dynamic image dis- 
playing screen 1 13, the user pushes the stop button 117 
to maintain the display of the particular frame of 20 
dynamic image. 

In a step S514. when the user selects an individual 
object in the object selecting unit 105. data of the 
selected individual object is transferred from the object 
data storing unit 92 to the selected object displaying unit 2s 
106, and the individual object is displayed on the static 
image or text displaying screen 1 1 4 or 1 1 5. 

In a step SSI 5, it is judged by the user which of a 
display start timing and a display finish timing is to be 
set 30 

In a step S516, the user pushes the display start 
timing setting button 1 18 in cases where the setting of 
the display start timing is selected in the step S515. 
Therefore, the display start timing for the selected indi- 
vidual object is set to the particular frame of dynamic 3s 
image. That is, the display of the selected irxJividual 
c^ject is started at the particular frame of dynamic 
image. 

In a step S517, the user pushes the display finish 
timing setting button 119 in cases where the setting of 40 
the display finish timing is selected in the step S515. 
Therefore, the display finish timing for the selected irxJi- 
vidual object is set to the particular frame of dynamic 
image. That is. the display of the selected individual 
object is finished at the particular frame of dynamic 4s 
image. 

In a step S518. H is judged by tiie user whether the 
display start timing and the display finish timing for all 
individual objects desired by the user to be selected in 
the object selecting unit 1 05 are set In cases where the so 
setting of the display start timing and the display finish 
timing is not finished, the steps S513 io S517 are 
repeated. 

An example of the above display timing setting 
operation performed to edit a scenario shown in Fig. 23 ss 
is described with reference to Figs. 32 and 33. 

Fig. 32 is a flow chart of a display timing setting 
operation performed by the user, and Figs. 33A to 33C 
respectively show an image view of the image screen 



122 of the selected object displaying unit 106. 

In a step S521, when the user selects the first 
dynamic image in the object selecting unit 105, as 
shown in Fig. 33A. a top frame FO of first dynamic image 
is displayed on the dynamic image displaying screen 
113. 

In a step S522. the first dynamic image is repro- 
duced, and the reproduction of the first dynamic image 
is stopped at a frame F1 of the first dynamic image. 

tn a step S523, the user selects the first static 
image In the object selecting unit 105, so that the first 
static image is displayed on the static image displa^ng 
saeen 1 14 as shown in Rg. 33B. 

In a step S524. the display start timing setting but- 
ton 1 18 is pushed, so that the display start timing for the 
first static image is set to the frame F1. 

In a step S525, the reproduction of the first dynamic 
image is again performed and is stopped at a trame F2 
of the first dynamic image. 

In a step S526. the user selects ttie first text in the 
object selecting unit 105, so that the first text is dis- 
played on the text displaying saeen 115 as shown in 
Fig. 33C. 

In a step S527, the display start timing setting but- 
ton 1 1 8 is pushed, so that the displ^ start timing for the 
first text is set to the frame F2. 

In a step S528. the reproduction of the first dynamic 
image is again performed and is stopped at a frame F3 
of the first dynamic image. 

In a step SS29. ttie user again selects the first static 
image. 

In a step S530. the display finish timing setting but- 
ton 119 is pushed, so that the display finish timing for 
the first static image is set to the frame F3. 

In a step S531 , the user again selects the first text. 

In a step S532, the display finish timing setting but- 
ton 119 is pushed, so that the display finish timing for 
the first text is set to ttie frame F3. 

Therefore, ttie user can perform the display timing 
setting operation while observing the dynamic image 
and the individual images displayed on the image 
screen 122. 

Next, an operation for selecting the dynamic image 
otsject and one or more individual objects in the steps 
S51 1 and S514 is desaibed in detail. 

Rg. 34 shows an example of object information 
stored in the object information storing unit 102. 

As shown in Fig. 34, a dynamic image abject name 
is attached to each of dynamic image ejects, and each 
dynamic image object is identified t)y a dynamic image 
management identification number. Also, a static image 
ct^ec* r%me Is attached to each of static image objects, 
and each static image object is identified by a ^tic 
image management identification number Also, a text 
object name is attached to each of text objects, arxi 
each text object is identified by a text management iden- 
tification number. Therefore, the objects stored in the 
object information storing unit 102 are managed t>y 
using tiie management identification numbers. 
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In the list displaying unit 103, pieces of object Infor- 
mation stored In the object information storing unit 102 
are referred, a plurality of object names are taken out in 
the order of increasing the management object nunt>er 
for each attribute, and a representative image indicating 5 
each of the objects specified by the object names is dis- 
played. In case of the dynamic image object informa- 
tion, a frame of represerrtative static image representing 
each dynamic image object is displayed. The represem- 
ative static images of the dynamic image objects are 10 
stored in the object information storing unit 102 in 
advance, arxl each representative static image is spec- 
ified by one dynamic image object name. In case of 
static image object infomriation. reduced data of each 
static image object is displayed. In case of text object is 
Information, a text titie and predetermined data called 
an icon are displayed for each text object. 

Thereafter, a user selects one dynamic image 
object and one or more inAMdual objects in the abject 
selecting unit 105 while observing the representative x 
static images displayed by the list displaying unit 103 in 
a list form. In this case, because the list displaying unit 
103 is enrtxxJied by the mouse 18. an indicating arrow 
is placed on each r^resentative static image, and the 
rrK)use 18 is clicked. Also, it is applicafc)ie that a touch 2s 
panel be used in place of the mouse 18. In this case, 
each representative static image is indicated by user's 
finger to select each dsject. 

Thereafter, the objects selected t>y the user are dis- 
played on the displaying screen 114 or 115 by the 30 
selected object displaying unit 107. That is. the object 
informatnn of the selected objects are read out from the 
object information storing unit 102, the layout intorma- 
tion of the selected objects are read out from the layout 
information storing unit 104, and each of the selected as 
individual objects is displayed on the displaying screen 
114or115ata fixed positton arxl a fixed size. 

Fig. 35 shows an exarrple of the layout information 
stored in frie layout information storing unit 104. As 
shown in Fig. 35. position information composed of X 40 
and Y coordinates and size information composed of a 
width and a height are stored in advance for each 
attribute. That is, the layout information for all dynamic 
images is predetermined, the layout information for all 
static images is predetermined, and the layout informa- 45 
tion for all texts is predetermined. 

Pieces of object information of the objects selected 
by the user in the obgect selecting unit 105 are stored in 
the selected object information storing unit 107. 
Because the pieces of object information are used to so 
assign each of the individual objects to one frame of 
dynamic image, the pieces of object inrormaiion stored 
in the selected object information storing unit 107 are 
deleted after the scenario is edited. 

Rg. 36 shows an example of the object information ss 
stored in the selected object information storing unit 
107. For example, when the user selects tfie first 
dynamic image in the step S521 of Fig. 32. the first 
dynamic image is displayed on the displaying screen 



113, and an object identification number "OOOI". an 
otoiect name "first dynamic image", a window identifica- 
tion number "^dynamic image WOOr and an attribute 
"dynamic image" are stored with contents of the first 
dynamic image 'm the selected object informatfon stor- 
ing unit 107. Mso. when the user selects the first statk; 
image a the first text in the step S523 or S526 of Fig. 
32, the forst static image or the first text is displayed on 
the displaying screen 11 4 or 1 15, and an object identifi- 
cation numtser "OOOI", an object name "first static 
image" or "first text", a window idOTtrfication number 
"static image W001" or "text W001" and an attribute 
"static image" or "text" are stored with contents of the 
first static image or the first text in the selected object 
information storing unit 107. 

Next, an operation for reproducing a dynamic 
image object in the step S51 3 is described in detail. 

In cases where a reproducing instruction is input to 
the reproducing and stopping instruction receiving unit 
108 the user, the dynamic image selected in the 
dsject selecting unit 105 is reproduced by the dyrmmic 
image reproducing unit 109. Also, in cases where a 
stopping instruction is input to the reproducing and 
stopping instruction receiving unit 108 by the user, the 
display of the dynamic image is stopped at a particular 
frame of dynamic image by the dynamic image repro- 
ducing unit 109, and the particular frame is stored in the 
time information detecting unit 1 10 as time information. 

Next, an operation for setting the display start tim- 
ing or the display finish timing In the step S516 or S517 
is described in detail. 

When the user inputs a scenario editing instruction 
to the scenario editing instruction receiving unit 1 12. a 
scenario is edited in the scenario editing unit 111. 

Rg. 37 is a ftow chart showing a scenario editing 
operation performed in the scenario editing unit 111. 

In a step S541 , when the display start timing setting 
button 1 1 8 or the display finish timing setting button 119 
is pushed by the user, a display start timing setting 
instruction or a display finish timing setting insti-uction is 
received in the scenario editing instruction receiving unit 
1 12 and is transmitted to the scenario editing unit 111. 

In a step S542, time information is obtained from 
the time information detecting unit 110. 

In a step S543. a window identification number cor- 
responding to the object selected in the step S514 is 
taken out from the selected object informatfon storing 
unit 107. 

In a step S544, it is judged by the scenario editing 
unit 111 which of the display start timing setting instruc- 
tfon and the display finish timing setting instructkHi is 

received. 

In a step S545, in cases where the display start tim- 
ing setting insti-uction is received in the step S541, lay- 
out information corresponding to tiie window 
identification number is taken out from the layout infor- 
mation storing unit 104. For example, tn cases where 
tiie window identification number "dynamic image 
wool " is taken out in the step S543, the layout infbrma- 
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tion composed of a width "W1". a height "HI", an X 
coordinate "XI" and a Y coordinate "Yl" is taken out 
from the layout information storing unit 104. Also, the 
ot^ect information corresponding to the object selected 
in the step S514 is received from the selected object 5 
information storing unit 107. 

In a step S546. title managing information, object 
managing information, message managing information 
and window managing information of a scenario are 
renewed according to the time infornation, the object 10 
information and tiie layout information. 

In a step S547, in cases where the display finish 
timing setting instruction is received in the step SS41. 
the display of the object corresponding to the window 
identification number is finished. is 

In a step S548. titie managing information and mes- 
sage managing information of a scenario are renewed. 

In cases where the steps S541 to S548 are finished 
for all objects selected in the object selecting unit 105. 
the titie managing information, the otaject managing 20 
information, the message managing information £ind the 
window managing information renewed in the steins 
S546 and 8548 are stored in the scenario storing unit 
90 as an edited scenario. 

For example, in cases where the display start timing 2S 
for the first static image is set in the step S524 of Fig. 
32. as shown in Rg. 38, the titie managing information, 
the object managing information, the message manag- 
ing inforrr^tion and the wirxJow managing information 
renewed in ttie step SS46 are obtained. Also^ in cases 30 
where the disislay f irvsh tinting for the first static image is 
set in the step SS30 of Fig. 32. the titie managing infor- 
mation and the message managing infbmriation are 
renewed in the step S548. and the titie managing infor- 
mation, the object managing information, the message 3S 
managing information and the window managing infor- 
mation shown in Fig. 39 are obtained. 

After the scenario is edited, when an object display 
instruction is input to tiie object display instruction 
receiving unit 91 by the user, the scenario stored in Uie 40 
scenario storing unit 90 is taken out to the object display 
corrtrot unit 93. and the dynamic image object and the 
individual objects assigned to the d^amic image object 
are displayed on the displaying screen 113 under the 
cortrol of the object display control unit 93. 45 

Accordingly, when a dynamic image object or an 
individual object is selected in the object selecting unit 
105. because the dynamic image object or the individ- 
ual object is immediately displayed on the displaying 
screen 113, 114or115 according to the layout informa- so 
tion stored in the layout information storing unit 104. the 
user can check bow the dynanrnc image object or ths 
individual object is shown on the displaying screen 1 13, 
114 or 115. 

Also, after the display finish timing for each of all ss 
selected individual objects is set. the display of the indi- 
vidual objects on the displaying screen 1 1 3 or 1 14 is fin- 
ished, and the dynamic Image object and the individual 
objects assigned to the dynamic image object are dis- 



played on tiie displaying screen 1 13. Therefore, even 
though the user does not perform an disi^yed image 
changing operation, the user can easily check how the 
dynamic image Is reproduced witfi the individual objects 
assigned to the dynamic image object 

(Seventh Emtxxliment) 

Rg. 40 is a block diagram of a hyper-video type 
scenario editor according to a seventh embodiment of 
the present invention. 

As shown in Fig. 40. a hyper^eo type scenario 
editor 131 comprises 

tfie object information storing unit 102, the object 
data storing unit 92. the Pst displaying unit 103. Vne 
layout information storing unit 104, the object 
selecting unit 105, the selected object displaying 
unit 106, the selected object information storing unit 
107. tiie scenario editing instruction receiving unit 
1 12. tiie time information detecting unit 110, 
a scenario editing unit 132 embodied tsy the CPU 
15 for editing a scenario by using the layout infor- 
mation stored in the layout information storing unit 
104. the dynamic image and irxjividual object infor- 
mation of the selected dynamic image and individ- 
ual objects stored in the selected object information 
storing unit 107 and the time information detected 
In the time information detecting unit 110 when the 
scenario editing insbuction is received in the sce- 
nario editing instruction receiving urtit 112 and 
altering the scenario, the scenario storing unit 90, 
ttie reproducing and stopping insb'uction receiving 
unit 108 for receiving a reproducing instruction or a 
stopping instruction to advance the display of a 
frame of dynamic image to a next frame or stop the 
display of the dynamic image and receiving a 
returning instruction to return a frame of dynamic 
image displayed on the displaying screen 113. 
a dynamic image reproducing unit 133 embodied 
by tiie CPU 15 for reproducing tiie dynamic image 
according to the reproducing instruction received in 
the reproducing and stopping instruction receiving 
unit 108 to advance a frame of dynamic image dis- 
played on the displaying screen 113 to a succeed- 
ing frame, adversely reproducing the dynamic 
image according to the returning instruction 
received in ttie reproducing and stopping instruc- 
tion receiving unit 1 08 to return a frame of dynamic 
image displayed on the displaying screen 1 13 to a 
previous frame and stopping the reproduction of the 
dynamic Image according to the stopping instruc- 
tion received in tiie reproducing and stopping 
instruction receiving unit 108 to maintain the display 
of the succeeding or previous frame, 
a displayed object information storing unit 134 for 
storing object information of one or more irxjividual 
objects which are displayed on the displaying 
screens 1 14 arxj/or 1 15 at the succeeding or previ- 



17 



33 



EP 0 758 115 A1 



34 



ous frame of dynamic image, 

the object display instruction receiving unit 91 and 

the object display control unit 93. 

In the above configuration, a first example in which s 
a scenario stored in the scenario storing unit 90 is 
altered by changing the display finish timing for one Indi- 
vidual object is shown in Rg. 41 A, a second example in 
which a scenario stored in the scenario storing unit 90 is 
altered by adding a new individual object of which an io 
attribute is the same as that of one present individual 
object used in the scenario on condition that a display 
start timing for the new individual object is earlier than 
that of the present individual object is shown in Fig. 41B. 
and a third example in which a scenario stored in the is 
scenario storing unit 90 is altered by adding a new indi- 
vidual object of which an attribute is the same as that of 
one present individual object used in the scenario on 
condition that a display start timing for the new individ- 
ual object is later than that of the present individual 20 
object is shown in Fig. 41 C. 

In the first example ^own in Rg. 41 A, after the sce- 
nario shown In Rg. 23 is edited, a returning instruction 
is input to the reproducing and stewing instruction 
receiving unit 1 08, a frame of the first dynamic image is 2s 
returned to a frame F5 placed between the frames F2 
and F3 according to the returning instruction, and the 
display finish timing for the first static image is changed 
from the frame F3 to the frame F5. 

In the second example shown in Rg. 41B. after the so 
scenario shown in Fig. 23 is edited, a returning insfruc- 
tion is input to the reproducing and stopping insfruction 
receiving unit 108. a frame of the first dynamic image is 
returned to a frame F6 preceding to the frame Fl 
according to the returning instruction, and a display ss 
start timing for a second static image is set. Because 
the layout information is fixed for each of the attritxjtes, 
two or more individual objects of the same attribute are 
not displayed at the same frame. Therefore, because 
the display start timing for the first static image object of 40 
which tiie attribute is the same as that of the second 
static image has been already set to the frame F1 , a dis- 
play finish timing for the second static image object is 
automatically set to the frame Fl . 

In the thiid example shown in Fig. 41 C. after the 4S 
scenario shown in Fig. 23 is edited, a returning instruc- 
tion is input to the reproducing and stopping instruction 
receiving unit 108. a frame of the first dynamic image is 
returned to a frame F7 placed between the frames F2 
and F3. and a display start timing for a second static so 
image is set to the frame F7. In this case, because the 
display start timing arxl the display finish timing for the 
first static image ot)ject have been already set to display 
the first static image at the frame F7. the display finish 
timing for the first static image object is automatically ss 
set to the frame F7. 

When a user inputs a returning instruction to the 
reproducing arxl stopping instruction receiving unit 108. 
the frame of the dynamic image displayed on the dis- 



playing screen 113 is returned by the dynamic image 
repiroducing unit 1 33. Thereafter, when the user inputs a 
stopping instruction to the reproducing and stopping 
insbiiction receiving unit 108. the reproduction of the 
d^amic image is stc^iped. and a particular frame of 
dynamic image is displayed on the displaying screen 
1 13. In this case, one or more pieces of ind'ividu^ object 
information of one or more individual objects displayed 
on the displaying screens 114 and/or 1 15 at the partic- 
ular frame are stored in tiie displayed object information 
storing unit 134. 

For example, in cases where the dynamic image is 
reproduced according to the scenarfo shown in Rg. 23 
and the reproduction of tiie dynamic image is stopped at 
a particular frame t>etween the frames Fl and F2. 
because the first static image is only displayed with the 
dynamic image at the particular frame, the object infor- 
mation shown in Fig. 42A is stored in the displayed 
object information storing unit 134. Also, in cases where 
tiie dynamic image is reproduced according to the sce- 
nario shown in Fig. 23 and the reproduction of the 
dynamic image is stopped at a particular frame between 
ttie frames F2 and F3. because the first static image 
arxi the first text are displayed with the dynamic image 
at the particular frame, the object information shown in 
Rg. 428 is stored in the displayed object information 
storing unit 134. 

Next, a scenario editing operation performed in the 
scenario editing unit 132 is described. 

Rg. 43 is a flow chart of a scenario editing opera- 
tion performed in the scenario editing unit 132. 

When a user inputs a scenario editing instiruction to 
the scenario editing instruction receiving unit 112 (step 
S6OI), a cunent frame of dynamic image displayed on 
the displaying screen 113 is transmitted as time infor- 
mation from the time information detecting unit 1 10 to 
ttie scenario editing unit 132 (step S602). Thereafter, it 
is judged by the scenario editing unit 132 whether or not 
the scenario editing instruction is a display start timing 
setting instruction for instixicting to set a display start 
timing for a particular individual object to the cunent 
frame (step S603). In cases where the display start tim- 
ing setting instruction is received in the scenario editing 
unit 132. a window Identification number for the particu- 
lar individual object is transferred from tine selected 
object information storing unit 107 to ttie scenario edit- 
ing unit 132 (step S604). Thereafter, layout inforntation 
for the particular individual object is transferred from the 
layout information storing unit 104 to the scenario edit- 
ing unit 132 (step S605). Thereafter, the time informa- 
tion, the object information and the layout information 
are added to title mananing information, object manag- 
ing Information, message managing information and 
wirxjow managing information of a scenario, and the 
scenario is output to the scenario storing unit 90 (step 
S606). That is. tiie display start timing for the particular 
individual object is set to the current frame in the sce- 
nario. 

Thereafter, a previous individual object of which a 
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display start timing is set to a frame preceding to the 
cun-ent frame is retrieved on condition that an erttritnite 
of the previous irxfividual object is the same as that of 
the particular individual otsject. Tliat is, an attribute of 
the particular individual object is retrieved from the mes- 
sage managing information of the scenario, the mes- 
sage managing information is searched in a past 
direction for the previous individual object (step S607}, 
and it is judged whether or not the previous individual 
object exists (step S608). tn cases where the previous 
individual object is found out a display finish timing for 
the previous individual object is automatically set to the 
current frame to alter the titie managing information and 
the message managing information of the scenario 
(step S609), and a searching operation for the previous 
individuat object is finished. 

For example, as shown in Fig. 41 C. in cases where 
the display start timing for the particular individual 
object "second static image object" is set to the current 
frame F7, the message managing Information is 
searched, and it is detected that the display start timing 
for the previous individual object "first static image 
object' is set to the frame F1 . and a display finish timing 
for Vne previous individual object "first static image 
object' is set to the frame F7. 

Thereafter, a previous individual object of which a 
dteplay start timing is set to a frame succeeding to the 
current frame is retrieved on condition that an attribute 
of the previous individual object is the same as that of 
the particular individual ot^ect. That is. an attribute of 
the particular individuai object is retrieved from the mes- 
sage managing information of the scenario^ the mes- 
sage managing Information is searched in a future 
direction for the previous individual object (step S610). 
and it is judged whether or not the previous individual 
dsject exists (step S61 1). tn cases where the previous 
individual object is found out, a display finish timing for 
the particular individual object is automatically set to a 
frame at which the display start timing for the previous 
individual object is set to alter the title managing infor- 
mation and the message managing information of the 
scenario (step S61 2), and a searching operation for the 
previous irKllvidual object is finished. 

For example, as shown in Fig. 41 B. in cases where 
the display start timing for the particular individual 
object "second static image objecr is set to the current 
frame F6, the message managing information is 
searched, and it is detected that the display start timing 
for the previous individual object "Yirst static image 
object" is set to the frame F1, and a display finish timing 
for the particular individual object "second static image 
c^ject" is set to tiie frame F1 . 

Thereafter, the titie managing information and the 
message managing information of the scenario altered 
in the steps S609 and S612 are output to tiie scenario 
storing unit 90 (step S618). and the scenario stored in 
the scenario storing unit 90 is renewed (step S619). 

in contrast, in cases where a display finish timing 
setting insbudion for instructing to change a display fin- 



ish timing for a particular individual object displayed on 
the displaying screen 1 14 or 1 15 to the current frame is 
received in the scenario editing unit 132 in the step 
S603, a particular window identification number for the 

5 particular individual object is transferred from the dis- 
played otqect information storing unit 134 to the sce- 
nario editing unit 132 (step S613), and the particular 
individual ofciject displayed on the displaying screen 114 
or 1 15 is deleted from the di^aying screen 114 (step 

10 S614). Thereafter, the message managing information 
of the scenario stored in the scenario storing unit 90 is 
searched in a future direction (S615). and it is judged 
whether or not a display finish timing for the particular 
individual object is found out (S616). In cases where a 

IB display finish timing for the particular individual ok^ect is 
found out, the display finish timing for the particular indi- 
vidual object is cfianged to the current frame to alter the 
scenario (step S61 7). 

R>r example, as shown in Fig. 41 A, in cases where 

20 the display finish timing for the particular individual 
ot)ject "first static image object" is set to the current 
frame F5, the message managing information is 
searched, and it is detected that the display finish timing 
for the particular individuai object "^irst static image 

25 object' is set to the frame F3. and a display finish tinning 
for the particular individual object "first static image 
otsject" is changed to the frame F5. 

Thereafter, the message managing information of 
the scenario is output to ttie scenario storing unit 90 

30 (step S620). and the scenario stored in ttie scenario 
storing unit 90 is renewed (step S619). AIsol in cases 
where any display finish timing for the particular individ- 
ual object is rtot found out in the step S61 6. a display fin- 
ish timing for the particular individual object is set to the 

35 current frame (step S621), and the scenario stored in 
the scenario storing unit 90 is renewed (step S619). 

N^. an example of the scenario altered by the 
hyper-video type scenario editor 131 is shown in each 
of Figs. 44 to 45. 

40 Fig. 44 shows an example of the message manag- 
ing information of the scenario altered according to a 
scenario altering operation shown in Fig. 41 A. 

As shown in Fig. 44, the display finish timing for the 
first static Image is changed to the frame 4. 

45 Fig. 45 shows an example of the scenario altered 
aocoiding to a scenario altering operation shown in Rg. 
41 B. 

As shown in Fig. 45. the number of objects in tiie 
titie managing information is increased as compared 

50 with that shown in Rg. 28A because of the addition of 
the second static image object, the secorxi static image 
cbjsct is (^ded to the object managing information as 
compared with that shown in Fig. 28B. the display start 
timing and the display finish timing for the second static 

55 image object are added to the message managing Infor- 
mation as compared with that shown in Rg. 28C, and 
layout irrformation of the secorxi static image object is 
added to the layout managing information as compared 
with that shown in Rg. 2BD. 
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Rg. 46 shows an example of the scenario altered 
according to a scenario altering operation shewn in Fig. 
41C. 

As shown In Rg. 46, the number of objects in the 
title managing information Is increased as compared 
with that shown in Rg. 28A because of the addition of 
the second static image object, the second static image 
object is added to the object managing information as 
compared with that shown in Rg. 28B, the display start 
tinting for the second static bnage object is added to the 
message managing information as compared with that 
shown in Rg. 28C. and layout Information of the second 
static image object Is added to the layout managing 
infbmntion as compared with that shown in Rg. 28D. 

Accordingly, in cases where a particular individual 
ot^ect is added to a scenario stored in tfie scenario stor- 
ing unit 90. because a frame of the dynamic image 
ot^ect displayed on the displaying screen 1 13 can be 
returned to a previous frame when a returning instruc- 
tion is input, even tiiough a previous individual object 
having the same attribute as that of the particular Indi- 
vidual object exists in the scenario, the scenario can be 
altered by automatically changing a display start timing 
or a display finish timing for the previous individual 
object 

Also, in cases where a display start timing or a dis- 
play finish timing for a particular individual object exist- 
ing in the scenario is changed, because a frame of tiie 
dynamic image object displayed on the displaying 
screen 113 can be returned to a previous frame when a 
returning instruction Is input, the scenario can be 
altered to change the display start timing or the display 
finish timing for the particular individual object 

Also, the altered scenario can be immediately 
checked t>y displaying the dynamic image with one or 
more irxlividual objects urxJer the control of the object 
display control unit 93. 

(Eightii Embodiment) 

Fig. 47 is a block diagram of a hyper-video type 
scenario editor according to an eighth emtxxJiment of 
the present invention. 

As shown in Rg. 47. a hyper-video type scenario 
editor 141 comprises 

the object information storing unit 102, the object 
data storing unit 92, tiie list displaying unit 103. the 
layout information storing unit 104. the object 
selecting unit 105, the selected object displaying 
unit 1 06. the selected object information storing unit 
107. 

a scenario editing instruction receiving unit 142 
emtxxiied by tiie mouse 18 tor receiving a display 
finish timing setting insfa-uction, 
the time information detecting unit 110. the sce- 
nario editing unit 1 32, the scenario storing unit 90. 
the reproducing and stopping instruction receiving 
unit 108, the dynamic image reproducing unit 133, 



the displayed object infbrmation storing unit 134. 
the object display insfa-uction receiving unit 91. the 
object display control unit 93. and 
a display start timing setting unit 143 for automati- 

5 cally setting a display start timing for a particular 

Individual object by o^nparing a first individual 
object displayed on the displaying screen 114 (or 
115) just after the stoppage of the reproduction of 
the dynamic image and a second individual (A)ject 

10 displayed on the same displaying screen 114 (or 
115) just before tiie reproduction of tiie dynamic 
image performed after the stoppage of the repro- 
(hjction of the dynamic image and instructing the 
scenario editing unit 1 32 to set the display start tim- 

15 ing for the particular irxlividual ot^ect in cases 
where the second individual object differs from the 
first incfividual ol^ect 

As shown in Rg. 48, the scenario editing Insti^jction 

20 receiving unit 1 42 has a display finish timing setting t>ut- 
ton 1 1 9 for setting a display finish timing for each of the 
selected individual objects, and any display start timing 
setting tMJtton is not provided for the scenario editing 
instruction receiving unit 142. 

25 In the above configuration, a scenario editing oper- 
ation performed in the hyper-video type scenario editor 
141 is described with reference to Fig. 49. 

Rg. 49 is a fkwv chart showing a scenario editing 
operation performed in tiie hyper-video type scenario 

30 editor 141. 

As shown in Fig. 49. a user selects a dynamic 
image object used as a time t>ase by inputting a 
dynamic image object name to the object selecting unit 
106 (step S701). Thereafter, the dynamic image object 

35 is reproduced on the displaying screen 113 until a par- 
ticular frame of the dynamic Image object is displayed 
(step S702). When the particular frame of the dynamic 
image object is displayed on the displaying screen 113, 
a stopping instruction is input to the reproducing and 

40 Stopping instruction receiving unit 108 to maintain tiie 
display of tiie particular frame (step S703). Thereafter, a 
particular individual object is selected in the object 
selecting unit 105 (step S704). Therefore, an individual 
object displayed on the displaying screen 1 1 4 (or 1 1 5) is 

45 changed to the particular irKtivkfual object, and object 
information of the particular individual object is stored In 
the selected object information storing unit 107. There- 
after, the change of the individual object displayed on 
the dl^laying screen 114 is detected by the display 

so start timing setting unit 143 (step S705). In other words, 
the change of the object Information stored in the 
selDCtsd object information storing unit 107 is detected 
by tiie display start timing setting unit 143. Also, It is 
judged by the display start timing setting unit 143 

55 whether or not a display finish timing setting instruction 
is received from the scenario editing instruction recav- 
ing unit 142 (step S706). 

In cases where any display finish timing setting 
instruction is not received from the scenario editing 
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instruction receiving unit 142 and the change of the 
object infonnation ie detected, it Is judged by the display 
start timing setting unit 1 43 that the particular individual 
object is input by the user to set a display start timing to 
the particular individuat abject. Therefore, a display start s 
timing setting instruction is trarsmitted from tfie display 
start timing setting unit 143 to the scenario editing unit 
132 (step S707). In the scenario editing unit 132, the 
object information of the particular individual object 
stored in the selected object Intormation storing unit w 
107. the layout information of the particular individual 
object stored in the layout information storing unit 104 
and the time Intomrtatlon stored in the time Information 
detecting unit 110 are received, and a display start tim- 
ing for the particular individual object is automatically is 
set to the particular frame (step S708). 

In contrast, in cases where a display finish timing 
setting instruction is received from the scenvio editing 
instruction receiving unit 1 42 in the Step S706, a display 
finish timing for the particular individual object is set to 20 
the particular frame (step S709). The steps S702 to 
S709 are repeated until the di^lay start timing and the 
display finish timing for all desired individual objects are 
set In cases where the display start timing and the dis- 
play finish tirrring for all selected individuaJ otJjects are 28 
set (step S71 0), the operation Is finished. 

Next, a scenario editing operation for editing the 
scenario shown in Fig. 23 in the hyper-video type sce- 
nario editor 141 is described with reference to Fig. 50. 

Fig. 50 is a flow chart showing a scenario editing so 
operation for editing the scenario shown in Rg. 23 in the 
hyper-video type scenario editor 141 . 

As shown in Fig. 50, a user selects the first dynamic 
image by inputting the first dynamic image object name 
to the object selecting unit 105 (step S721). Thereafter, 3s 
the first dynamic image Is reproduced on the displaying 
screen 1 13, and the frame F1 of the first dynamic Image 
Is disr^ayed (step S722}. Thereafter, the first static 
Image is selected In tiie object selecting unit 105 (step 
S723). Therefore, an Individual object displayed on the 40 
displaying screen 114 is changed to the first static 
Image, and the change of the individual object displayed 
on the displaying screen 114 is detected by the display 
start timing setting unit 143. In this case, the user does 
not push the display finish timing setting txjtton 1 19. so 4s 
that a display start timing for the first static image is 
automatically set to tiie frame F1 (step S724). 

Thereafter, the reproduction of the first dynamic 
image is restarted, and the frame F2 of the first dynamic 
image is displayed on the displaying screen 1 13 (step so 
S725). Thereafter, the first text is selected in the object 
selecting unit 105 (step S726). Therefore, an individuai 
object displayed on the displaying screen 115 is 
changed to the first text, and the change of tiie Individ- 
ual object displayed on the displaying screen 114 Is ss 
detected by tiie display start timing setting unit 143. In 
this case, ttie user does not push the display finish tim- 
ing setting button 1 19, so that a display start timing for 
the first text is automatically set to the frame F2 (step 



5727) . 

Thereafter, tiie reproduction of the first dynamic 
image is restarted, and the firame F3 of the first dynamic 
image is displayed on the displaying screen 113 (step 

5728) . Thereafter, the first static image and the first text 
are selected In the object selecting unit 105 (step S729). 
In this case, an individual object displayed on the dis- 
playing screen 114 Is maintained to the first static 
Image, and an Individual object displayed on the dis- 
playing screen 1 15 Is maintained to the first text. There- 
after, the user pushes the display finish timing setting 
button 1 19 (step S730}. so that a display finish timing for 
tiie first static image is set to the frame F3, and a display 
finish timing tor the first text is also set to the frame F3 
(step S731). 

Next, the operation perfbrmed in the display start 
timing setting unit 143 is described in detail with refer- 
ence to Fig. 51 . 

Rg. 51 is a flow chart showing the operation per- 
formed in the display start timing setting unit 143. 

As shown in Fig. 51 . when a reproducing instruction 
or a stopping instruction is received from the reproduc- 
ing and stopping instruction receiving unit 108 (step 
S741). It is judged which of the reproducing instixiction 
and the stopping Instruction Is received (step S742}. In 
cases where the stopping instruction Is received, a 
reproduction stopping instruction is sent to tiie dynamic 
image reproducing unit 133 (step S743), so that the 
reproduction of the dynamic image object Is stopped. 

In oomrast. in cases where the reproducing instruc- 
tion is received in tiie step S741 . it is judged whether or 
not the individual otiject displayed on the displaying 
screen 114 or 115 is changied (step S744}. In other 
words, it is judged whetiier or not tiie individual object 
infonnation stored in the selected object information 
storing unit 107 Is changed. In cases where the individ- 
ual object displayed on the displaying saeen 1 1 4 or 11 5 
is changed, a display start timing setting instruction is 
sent to the scenario editing unit 132 (step S745), object 
Information of a particular individual object stored in the 
selected object Information storing unit 107 is trans- 
ferred to the scenario editing unit 132. and a display 
start timing for the particular individual object is set to a 
frame irKDcated by tfie time Irrformation stored in the 
time information detecting unit 110. Thereafter, tiie 
reproducing instruction is sent to the dynamic image 
reproducing unit 133 (step S746), so that the reproduc- 
tion of the dynamic Image obgect is restarted. In con- 
trast, in cases where the individual olaject displayed on 
the displaying screen 1 14 or 1 15 is not changed in the 
step S744, the procedure proceeds to the step S746. 

Accordingly, because the change of the irKlividual 
object displayed on the displaying screen 1 1 4 or 1 15 is 
detected by the display start tinting setting unit 143, tiie 
display start timing can be automatically set for each 
individual object. Therefore, tiie scenario editing opera- 
tion can be efficlentiy performed, arxj the user can per- 
form the scenario editing operation with easy wnthout 
manually performing the setting of the display start tim- 
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ing. 

(Ninth ErnbodmenQ 

Fig. 52 is a block diagram of a hyper-video type s 
scenario editor according to a nimh embodiment of the 
present invention. 

As shown in Fig. 52, a hyper-video type scenario 
editor 151 comprises 

the object information storing unit 102, 
the object data storing unit 92. ^e list displaying 
unit 103, the layout information storing unit 104, the 
object selecting unit 105 embodied by a touch 
panel 1 52 displayed on an image screen of the dis- 
play 16, the selected object displaying unit 106. the 
selected object information storing unit 107. the 
scenario editing instruction receiving unit 112 
embodied tiy the touch panel 152, the reproducing 
and stopping instruction receiving unit 108 embod- 
ied by the touch panel 152, the dynamic image 
reproducing unit 109, the time information detecting 
unit 1 10. the scenario editing unit 1 1 1 . the scenario 
storing unit 90. the object display instruction receiv- 
ing unit 91 embodied by the touch panel 152 and 
the object display control unit 93. 



Having illustrated and described the principles of 
the present invention in a preferred errtxxfiment 
thereof, it should be readily apparent to those sMned in 
ttie art that the invention can be modified in arrange- 
ment and detail without departing from such principles. 
We daim all nrKXlificalions coming within the spirit cmd 
scope of the accompanying claims. 

A plurality of individual objects is put together to a 
group of page type objects in a page type object produc- 
ing unit When a display timing and a deletion timing for 
the grotp of page type objects are input, a page change 
timing of each of the page type objects in the group is 
automatically set in a page change timing setting unit to 
display the page type objects with a dynaniic image at 
equal intervals in a display period between the display 
timing and the deletion timing. Therefore, it is not 
required to input a display timing and a deletion timing 
for each of the individual ot^ects for the purpose of edit- 
ing a scenario in which the individual objects are 
assigned to frames of dynamic image to display tiie indi- 
vidual objects with the dynamic image, and a scenario 
editing operation can be easily performed. 

Claims 

1 . A scenario editor, comprisi ng : 
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The reproduction txitton 116 and the stop txrtton 
117 of the r^roducing and stopping insta'uction receiv- 
ing unit 108, the display start timing setting button 1 18 
and tiie displ^ finish timing setting button 119 of the 
scenario editing instruction receiving urtit 112 and the 
display object changing buttons 121 and tiie object list 
display screen 120 of the list displaying unit 103 are dis- 
played on the touch panel 152. Therefore, the user can 
operate each of the buttons by pushing the touch panel 
152. 

In the above configuration, the selection of the 
dynamic image object and the individual objects can be 
performed when the user pushes the object list display 
screen 120 displayed on the touch panel 152. Also, var- 
ious instructions can be input when the user pushes the 
buttons. 

Accordingly, twcause the user can operates the 
hyper-video type scenario editor 151 while seeing the 
list of the objects and the buttons on the touch panel 
1 S2. a scenario editing operation can be performed in a 
form of WYSIWYG (what you see is what you get), and 
the scenario editing operation can be efficientiy per- 
fbrmed. In this en^xxiiment, the touch panel 152 is 
used. However, it is af^iicable that a pen inputting 
apparatus, a voice inputting apparatus for recognizing a 
voice insti-uction of the user or a wireless remote control 
inputting apparatus be used in place of the touch panel 
152. 

Also, in the above embodiments, tiie frame is used 
as the tame information. However, it is applicable that a 
time stamp attached to the dynamic image be used as 
the time information. 



object information storing means for storing a 
plurality of incRvidual objects; 
page type object producing means for produc- 
ing one or more groups of page type ot^ects 
from the individual objects stored in the object 
infbrmation storing means according to a 
user's request; 

object selecting means for selecting a particu- 
lar group of page type objects from among the 
groups of page type objects produced in the 
page type object producing means; 
scenario information inputting means for input- 
ting a piece of intermediate scenario informa- 
tion indicating a display timing of the particular 
group of page type objects selected by the 
object selecting means and a deletion timing of 
the particular group of page type objects: and 
page change timing setting means for setting a 
display change timing of each of the page type 
objects in the particular group selected by the 
object selecting means according to the display 
timing and the deletion timing of the intermedi- 
ate scenario information input tsy the scenario 
information inputting means arxi assigning the 
pags ^ype objects In the particular group to a 
dynamic image at the display change timing set 
for each of the page type objects to edit a sce- 
nario composed of the dynamic image and the 
page type objects in the particular group. 

2. A scenario editor according to claim 1 in which tiie 
page type objects in the particular group are auto- 
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44 



matically assigned to the dynamic image at equal 
intervals by the page change timing setting means 
in a display period between the display timing and 
the deletion timing input to the scenario information 
inputting means. 

3. A scenario editor according to dalm 1 in which the 
page type objects in the particular group are manu- 
ally assigned to the dynamic image at desired inter- 
vals by the page change timing setting means in a 
display period between the display timing and the 
deletion timing input to the scenario information 
inputting means. 

4. A scenario editor according to daim 1 in which the 
display change timing for each of a part of the page 
type objects in the particular group is set by the 
page change timing setting means, and the sce- 
nario editor further comprising 

page type object resetting means for resetting 
the remaining part of the page type objects in 
the particular group to a new group of page 
type objects. 

5. A scenario editor according to daim 1 in which 
each of the individual objects stored in the object 
information storing means is a static image or a 
text. 

6. A scenario reproducing apparatus of multimedia 
data for reprodurang a scenario in which a group of 
page type objects, comprising: 
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layout information receiving means for receiv- 
ing pieces of layout information of a plurality of 
individual objects; 

layout information storing means for storing the 
pieces of layout information received by the lay- 
out information receiving means; 
object specifying means for specifying a 
dynamic image object and one or more individ- 
ual objects selected by a user; 
time information receiving means tor receiving 
a display start time and a display finish time tor 
each of the individual objects specified by the 
object specifying means: 
time informatton storing means for storing the 
display start time and the display finish time 
received by the time information receiving 
means tor each of the irxlividual objects: and 
scenario editing means for assigning each of 
the incfividua] objects specified by the object 
specifying means to the dynamic inr^ge object 
specified by the object specifying means 
according to the pieces of layout information 
stored in the layout information storing means 
to start the display of each of the individual 
objects at the display start time stored in the 
time information storing means and finish the 
display of each of tiie individual objects at the 
display finish time stored in the time informa- 
tion storing means and obtaining a time rela- 
tionship between the dynamic image object 
and each of the individual objects assigned to 
the dynamic image object as an edited sce- 
nario 



object information storing mesuis for storing the 3S 8. 
group of page type objects; 
scenario information storing means for storing 
a piece of scenario information of the scenario; 
scenario control means for outputting a display 
message or a deletion message of each of the 40 
page type objects in the group stored In the 
object information storing means according to 
the scenario information stored in the scenario 
information storing means; 
page change control means for performing a 4s 
page change operation for the page type 
objects in the group stored in the object infor- 
mation storing means according to a user's 
request; and 

object displaying means for displaying or delet- so 
ing each of the page type objects in the group 
stored in the object information storing means 
in a display period indicated by the scenario 
information according to ttie page change 9. 
operation performed by the page change con- 55 
frol means. 

7. A scenario editor, comprising: 



A scenario editor aoconding to claim 7, further com- 
prising: 

selected object information storing means for 
storing pieces of object information of the 
dynamic image object and the individual 
objects specified by ttie object specifying 
means, each piece of object Information being 
composed of an object name, an object identi- 
fication number, a window identification 
number for identifying a window used to display 
a corresponding dynamic image or irxlividual 
object and an atb'ibute indicating a type of the 
corresponding dynamic image or individual 
object, and 

the pieces of object information being taken in 
the scenario edited by the scenario editing 

msEsns. 

A scenario editor according to claim 7, further com- 
prising: 

object display instruction receiving means for 
receiving an object display instruction; 
object display omtrolling means for controlling 
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the display of the dynamic image object and 
the individual otqects aooording to the ofajject 
display instruction received by the object dis- 
play instruction receiving means: and 
object displaying means for displaying the 
dynamic irrmge object and the individual 
objects assigned to the dynamic image object 
according to the scenario edited by the sce- 
nario editing means under the control off the 
object display controlling means. 

10. A scenario editor according to daim 7, further conn- 
prising: 

object information storing means for storing a 
plurality of representative images for a plurality 
of dynamic image objects and a plurality of indi- 
vidual objects: 

list displaying means for displaying the repre- 
sentative images stored in the object informa- 
tion storing means in a list form, the dynamic 
image object and the individual dbjects speci- 
fied by the object specifying means bdng 
selected by the user while the user refers the 
representative images displayed by the list dis- 
playing means. 

11. A scenario ecfitor according to daim 7 in which the 
individual Objects are dassified into one or more 
static image objects and one or more text ok^ects. 
the pieces of layout information for the static image 
objects stored in the layout infonmation storing 
means are the Seune each other, and the pieces of 
layout information fbr the text objects stored in the 
layout information storing means are the same 
each other. 

12. A scenario editor comprising: 

object selecting means for selecting a particu- 
lar dynamic image object from a plurality of 
dynamic image objects and selecting a particu- 
lar individual object from a plurality of indi\ndual 
objects; 

layout information storing means for storing a 
piece of dyrtamic image layout information for 
the dynamic image ot^eds in common and a 
piece of individual object layout information for 
the individual objects in conunon; 
reproducing and stopping instruction receiving 
means for receiving a reprodudng instrudion 
and a stopping instrudion; 
dynamic image reproducing means for repro- 
dudng the particular dynamic image object 
seteded by the objed selecting means frame 
l3y frame according to the reprodudng instruc- 
tion received by the reproducing and stopping 
instruction receiving means and stopping the 
reproduction of the particular dynamic image 



object at a particular frame according to the 
stopping instruction received by the reproduc- 
ing and stopping instruction receiving means; 
time information storing means for storing the 
particular frame of the particular dynamic 
image object crtitained by the dynamic image 
reprodudng mear^; 

seleded objed displaying means for displaying 
the particular dynamic image objed and the 
particular indi\^dual objed seleded by the 
objed selecting means, displaying the particu- 
lar dynamic image objed frame by frame 
according to the reproducing instruction 
received by the reproducing and stopping 
instruction receiving means and maintaining 
the display of the particular frame of the partic- 
ular dynamic image objed according to the 
stopping instrudion received by the reproduc- 
ing and stopping instrudion receiving means; 
scenario editing insfruction receiving means for 
receiving a display start timing or a display fin- 
ish timing; ^d 

scenario editing means for assigning the par- 
ticular individual objed seleded by the object 
selecting means to tiie particular dynamic 
image objed seleded by tiie objed selecting 
means according to the dynamic image layout 
information and tiie irxJividual object layout 
information stored in the layout information 
staring means to start the display of the partic- 
ular individual objed at the particular frame of 
the particular dynamic image in cases wtiere 
the display start timing is received by the sce- 
nario editing instrudion receiving means and to 
finish the display of the particular individual 
objed at the particular frame of the particular 
dynamic image in cases where the display fin- 
ish timing is received by the scenario editing 
instrudion receiving means and obtaining a 
time relationship between the particular 
dynamic image objed and the particular indi- 
vidual objects assigned to tiie particular 
dynamic image objed as an edited scenario. 

13. A scenario editor according to claim 12, further 
comprising: 

seleded objed information storing means tar 
storing pieces of objed information for the par- 
ticular dynamic image objed and the particular 
individual objed seleded by ttie objed seled- 
ing means, each piece of objed information 
being conposed of an d^jed name, an objed 
identification number, a window identification 
number for identifying a wrindow used to di^lay 
a corresponding particular dynamic image or 
individual objed and an atfribute indicating a 
type of the corresponding particular dynamic 
image or individual object and the pieces of 
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abject infbrmation being taken in the ecenario 
edited bf the scenario editing means. 



14. A scenario editor according to daim 12. further 

comprising: 5 

object display instruction receiving means for 
receiving an object display instruction; arxJ 
object display controlling means for controlling 
the selected object displaying means accord- io 
ing to the object display instruction received by 
the object display instruction receiving means 
to display the particular dynamic image object 
and the particidar individual otsject according to 
the scenario edited by the scenario editing is 
means. 

15. A ecenario editor according to daim 12, further 
comprising: 

20 

object information storing means for storing a 
plurality of representative images for the 
dynamic image objects and the individual 

objects; 

list displaying means for displaying the repre- 25 
sentative images stored in the object informa- 
tion storing means in a list form, the particular 
dynamic image object and the particular indi- 
vidual object selected by the object selecting 
means being specified by the user while the 30 
user refers the representative images dis- 
played by the list displaying means. 

16. A scenario editor according to claim 12 in which the 
individual objects are classified into one or more 35 

static image otijects and one or more text objects, 
the individual ot^ect layout information stored In the 
layout information storing means is classified into a 
piece of static image c^ject layout information and a 
piece of text object layout information, the static 40 
image otsject layout information is in common to the 
static image objects, and the text object layout infor- 
mation is in common to the text objects. 

17. A scenario editor according to daim 12 in which a 4s 
retuming instrudion is received by the reprodudng 
and stopping instruction receiving means, the 
reproduction of the particular dynamic image is 
returned to a current firame by the dynamic image 
reproducing means according to the returning so 
instruction, a second display finish timing is 
received by the scenario editing instruction receiv- 
ing means, and the scenario in which the display of 
the particular individual object assigned to the par- 
ticular dynamic image object by the scenario editing ss 
means Is finished at the particular frame of the par- 
ticular dynamic image object is altered by the sce- 
nario editing means to a scenario in which the 
display of the particular irxiividual objed is finished 
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at the current frame of the particular dynamic image 
objed. 

1& A scenario editor accorcGng to daim 12 in which a 
current individual object is seleded by the objed 
selecting means, a returning instrudion is received 
by the reprodudng and stopping instrudion receiv- 
ing means, the reproduction of the partiadar 
dynamic image is returned to a current frame prior 
to the particular frame by the dynamic image repro- 
ducing means according to the returning instruc- 
tion, a second display start timing is received by the 
scenario editing instrudion receiving means, and 
the scenario in which the display of the particular 
individual objed assigned to the particular dynamic 
image objed by the scenario editing means is 
started at the particular frame is altered by the sce- 
nario editing means to a scenario in whidi tfie dis- 
play of the particular individual objed is started at 
the particular frame, the display of the cunent indi- 
vidual objed is started at the current frame and the 
display of tiie current individual objed is finished at 
the particular frame. 

19. A scenario editor according to claim 12 in which a 
current individual objed is seleded by the objed 
seleding means, a returning instrudion is received 
by tine reproducing and dopping instrudion receiv- 
ing means, the reproduction of the particular 
dynamic image is returned to a current frame by tfie 
c^namic image reproducing means according to 
the returning instruction, a second display start tim- 
ing is received by the scenario editing instruction 
receiving means, and the scenario in which tfie dis- 
play of the particular indiwdual objed assigned to 
the particular dynamic image objed by the scenario 
editing means is started at the particular frame prior 
to the current frame is altered by the scenario edit- 
ing means to a scenario in which the display of the 
particular individual objed is started at the particu- 
lar frame, the display of the particular individual 
objed is finished at the current frame and the dis- 
play of the current Individual objed is started at tfie 
cunent frame. 

2a A scenario editor according to daim 12, further 
comprising: 

display start timing setting means for detecting 
whether or not an individual objed displayed by 
the seleded objed displaying means is 
changed to a second particular individual 
objed during tiie display of a second particular 
frame of the particular dynamic image main- 
tained by tiie dynamic image reproducing 
means and outputting a display start timing for 
the second particular individual objed to the 
scenario editing means regsirdiess of whether 
another display start timing for the second par- 
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ticular individua! object is received by the sce- 
nario editing instruction receiving means in 
cases where tfie display of the current individ- 
ual object is detected, the second particular 
individual object being assigned to the particu- 5 
lar dynamic image object by the scenario edit- 
ing means to start the display of the second 
partcular individual object at the second partic- 
ular frame. 

10 

21 . A scenario editor acoorcfing to dalm 12 In which tfie 
object selecting means, the scenario editing 
instruction recehnng means and the reproducing 
and s t o p fMng instruction recenring means are 
entxxJied by a touch panel. is 



20 



28 



30 



3S 



40 



45 



SO 



26 



EP 0 758 115 A1 



FIG. 1 



,13 



ROM 



RAM 



J 4 



i CL 



' — ^ 

KEYBOARD j 



15 



CPU 



18 



MOUSE I 



J 6 



,17 



DISPLAY 



HARD DISK K 



FIG. 2 



USER' S 
SELECTION 



USER* S 
INPUT 





OBJECT 
INFORMATION 
STORING 
UNIT 

PAGE TYPE 
OBJECT 
PRODUCING 
UNIT 



,24 



OBJECT 

SELECTING 

UNIT 



25 



SCENARIO 
INFORMATION 
INPUTTING 
UNIT 



.27 



.26 



PAGE CHANGE 
TIMING 
SETTING 
UNIT 



SCENARIO 
INFORMATION 
STORING 
UNIT 



7 



TO SCENARIO 
REPRODUCING 
UNIT 



27 



EP0 758115A1 



FIG, 3 



DYNAMIC IMAGE 
MANAGEMENT 
IDENTIFICATION 
NUMBER 


DYNAMIC 
IMAGE 

OBJECT NAME 


DYNAMIC IMAGE 
0001 


FIRST 

DYNAMIC 

IMAGE 


DYNAMIC IMAGE 
0002 


SECOND 

DYNAMIC 

IMAGE 


DYNAMIC IMAGE 
0003 


THIRD 

DYNAMIC 

(MAGE 



INDIVIDUAL OBJECT 
MANAGEMENT 
IDENTIFICATION 
NUMBER 


INDIVIDUAL 
OBJECT NAME 


STATIC IMAGE 
0001 


FIRST 
STATIC 
. IMAGE 


STATIC IMAGE 
0002 


SECOND 
STATIC 
IMAGE 


STATIC IMAGE 
0003 


THIRD 

STATIC 

IMAGE 



INDIVIDUAL OBJECT 
MANAGEMENT 
IDENTIFICATION 
NUMBER 


INDIVIDUAL 
OBJECT NAME 


TEXT 0001 


FIRST TEXT 


TEXT 0002 


SECOND TEXT 


TEXT 0003 


THIRD TEXT 


FIG, 


4 



rAHRIBUTE 1 
[INFORMATIONJ 

[PAGE NUMBER] 



STATIC IMAGE 



20 



[PAGE INFORMATION] 

FIRST STATIC IMAGE 

SECOND STATIC IMAGE 

: 
: 

TWENTIETH STATIC IMAGE 



Fattribute 1 
[information J 



TEXT 



[PAGE NUMBER] 10 

[PAGE INFORMATION] 

FIRST TEXT 

SECOND TEXT 



TENTH TEXT 



28 



EP 0 758 115 A1 



FIG. 5 
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FIG. 8A 
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FIG, 10A 
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FIG, 19B 
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FIG. 21 B 
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